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PREFACE 


This is the third volume in a series which Dover Publications is issuing. 
Each volume in the series is to be a collection of significant papers in a giv¬ 
en branch of science. The previous volumes (‘ Foundations of Nuclear Physics’ 
edited by R. T. Beyer, and ‘Foundations of High Speed Aerodynamics,’ edited 
by G. F. Carrier) covered the fields of nuclear physics and the flow of com¬ 
pressible fluids. Random processes, and their applications to physical ques¬ 
tions, are treated in the present volume. 

The papers have been chosen with certain assumed interests and needs of 
American physicists and engineers in mind. It was felt, first, that a handy ref¬ 
erence work containing a number of well known reprints would be of value to 
people concerned with ‘noise,’with Brownian motion, and with statistical me¬ 
chanics. Secondly, it seemed that a collection of some diversified introduc¬ 
tions to noise theory and to the theory of fluctuation phenomena would be use¬ 
ful for workers new to these subjects. This collection, therefore, consists al¬ 
most entirely of reprints of ‘review’ papers. 

The references cited in each paper form a working bibliography of the 
literature up to about 1940-45. The following publications describe more re¬ 
cent work, and contain supplementary references to earlier investigations : 


J. L. Doob, ‘Stochastic Processes,’ John Wiley & Sons, Inc. New York. 1953 

An advanced mathematical treatise. Extensive bibliography of .the mathe¬ 
matical literature. - v * ’ • * **. s% 

w. Feller, • An Introduction to Probability Tfteo'ry and its Applications^ Volume 

One, John Wiley &, Sons, Inc., New Yot£, 1950 . ' •; 

A number of applications to physits and engineering^are given. Considers 
holding and waiting time problems. 

W. Jackson, ‘Communication TheoA,; Cutterworths Scientific Publications 
on on, 1953. (U.S. A. Edition published by Academic Pr ess, Inc., New York)’ 
symposium on applications of communication theory. One section io r-™ 

cerned with signal discrimination in the presence ofPohe 
Pp U T50- 2 °82 R ° yal StaUstiCal S ° cia 'V. Series B, Volume II, No. 2 . 1949 , 


»**•«- *•— 


Tiscussions of noise and of fluctuation phenomena in a wide variety of de¬ 
vices, are scattered through the series. The index, vol. 28, 1953, gives 
specific references . 


University of Illinois 
Urbana, Illinois 


Nelson Wax 



CONTENTS 


Chandrasekhar, S. Stochastic Problems in Phy’s ics and A stronomy 
(from Reviews of Modern Physics, Vol. 15, No. 1) 

3 


Uhlenbeck, G. E. and Ornstein, L,. S. On the Theory of the Brownian 

Motion (from Physical Review, Vol. 36, No. 3) 

93 

Ming Chen Wang and Uhlenbeck, G. E. On the Theory of the Brownian 
Motion II (from Reviews of Modern Physics, Vol. 17, Nos. 2 and 3) 

113 

Rice, S. O. Mathematical Analysis of Random Noise 
(from Bell System Technical Journal, Vols. 23 and 24) 

133 

Kac, Mark Random Walk and the Theory of Brownian Motion 
(from American Mathematical Monthly, Vol. 54, No. 7) 

295 

Doob. J. L. The Brownian Movement and Stochastic Equations 
(from Annals of Mathematics, Vol. 43, No. 2) 

319 




PAPERS 




REVIEWS OF 


Modern Physics 



Volume 15, Number 1 


January, 1943 



Stochastic Problems in Physics and Astronomy 

S. Chandrasekhar 

Yerkes Observatory, The University of Chicago, Williams Bay, Wisconsin 


C ONTENTS 


INTRODUCTION. 

CHAPTER I. THE PROBLEM OF RANDOM FLIGHTS 

1. The Simplest One-Dimensional Problem: The Problem of Random Walk 

2. Random Walk With Reflecting and Absorbing Barriers 

3. The General Problem of Random Flights: Markoff’s Method. 

4. The Solution to the General Problem of Random Flights 

5. The Passage to a Differential Equation: The Reduction of the Problem of Random 
Flights for Large N to a Boundary Value Problem 


Pack 

2 

3 

3 

5 

8 

10 

16 


CHAPTER II. THE THEORY OF THE BROWNIAN MOTION 

1. Introductory Remarks: Langevin’s Equation 

2. The Theory of the Brownian Motion of a Free Particle 

3 * Bound^Partide^b* Brt>Wnian Motion of a Particl « in a Field of Force. The Harmonically 

4. The Fokker-Planck Equation. The Generalization of Liouville’s Theorem . 

5. General Remarks . . . 


20 

20 

21 

27 

31 

42 


44 


44 


CHAPTER rn. PROBABILITY AFTER-EFFECTS: COLLOID STATISTICS THE SPrniwn i aw 

o“r^n^L C bar^e T r“° RY OF COAGULATION ' ““"T*™"’ AND THE escape 

u General Theory of Density Fluctuations for Intermittent Observation* The Mean 
Life and the Average Time of Recurrence of a State of Fluctuation 

2. Experimental Verification of Smoluchowski’s Theory: Colloid Statistics. 48 

3. Probability After-Effects for Continuous Observation . 

7. The Escape of Particles over Potential Barriers. . 

OP THE 

i “zVw * sur; 0u,Iin ' of *•■— “•‘-oo . 

3. The Speed of Fluctuations in F . . 


59 

63 

68 

68 

70 

74 


1 




















2 


S . C H A N D R A S E K H A R 


APPENDIXES 


I. THE MEAN AND THE MEAN SQUARE DEVIATION OF A BERNOULLI DISTRIBUTION 

II. A PROBLEM IN PROBABILITY: MULTIVARIATE GAUSSIAN DISTRIBUTIONS 

III. THE POISSON DISTRIBUTION AS THE LAW OF DENSITY FLUCTUATIONS. 

IV. THE MEAN AND THE MEAN SQUARE DEVIATION OF THE SUM OP TWO PROBABILITY 

DISTRIBUTIONS.. 

V. ZERMELO’S PROOF OF POINCARES THEOREM CONCERNING THE QUASI-PERIODIC 
CHARACTER OF THE MOTIONS OF A CONSERVATIVE DYNAMICAL SYSTEM 

VI. BOLTZMANN’S ESTIMATE OF THE PERIOD OF A POINCARfi CYCLE. 

VII. THE LAW OF DISTRIBUTION OF THE NEAREST NEIGHBOR IN A RANDOM DISTRIBUTION 
OF PARTICLES. 

BIBLIOGRAPHICAL NOTES . 


79 

80 
81 

83 

84 

85 

86 
87 


INTRODUCTION 

\ this review we shall consider certain funda¬ 
mental probability methods which are finding 
applications increasingly in a wide variety of 
problems and in fields as different as colloid 
chemistry and stellar dynamics. However, a 
common characteristic of all these problems is 
that interest is focused on a property which is 
the result of superposition of a large number of 
variables, the values which these variables take 
being governed by certain probability laws. 
We may cite as illustrations two examples: 

(i) The first example is provided by the prob¬ 

lem of random flights. In this problem, a par¬ 
ticle undergoes a sequence of displacements 
T \, r 2 , •••, the magnitude and direction 

of each displacement being independent of all 
the preceding ones. But the probability that the 
displacement r, lies between r, and r,-\-dr, is 
governed by a distribution function r,(r,) as¬ 
signed a priori. We ask: What is the probability 
W(R)dR that after N displacements the co¬ 
ordinates of the particle lie in the interval 
R( = D*. Z J ) a °d R + dR. It is seen that in this 
problem the position R of the particle is the 
resultant of N vectors, r,, (i=l, •••, jV) the 
position and direction of each vector being 
governed by the probability distributions r,(r,). 
As we shall see the solution to this problem 
provides us with one of the principal weapons of 
the theory. 1 

(ii) We shall take our second illustration from 
stellar dynamics. The gravitational force acting 
on a star (per unit mass) is given by 

F = G2M,Ti/ \ r, |* (1) 

1 For historical remarks on this problem of random 
flights see the Bibliographical Notes at the end of the 
article. 


where M t denotes the mass of a typical “field" 
star and r, its position vector relative to the 
star under consideration and G the constant of 
gravitation. Further in Eq. (1) the summation is 
extended over all the neighboring stars. We now 
suppose that the distribution of stars in the 
neighborhood of a given one is subject to fluctua¬ 
tions and that stars of different masses occur in 
the stellar system according to some well 
defined empirically established law. However, 
the fluctuations in density are assumed to be 
subject to the restriction of a constant average 
density of n stars per unit volume. We ask: 
What is the probability that F lies between 
F and F-\-dF ? Again, the force acting on a star 
is the resultant of the forces due to all the neigh¬ 
boring stars while the spatial distribution of 
these stars and their masses are subject to well- 
defined laws of fluctuations. 

From the foregoing two examples it is clear 
that one of the principal problems under the 
circumstances envisaged is the specification of 
the distribution function of a quantity <I> 

(in general a vector in hyper-space) which is the 
resultant of a large number of other quantities 
having assigned distributions over a range of 
values. A second fundamental problem in the 
theories we shall consider concerns questions 
relating to probability after-effects 2 —a notion 
first introduced by Smoluchowski. We may 
broadly describe the nature of these questions 
in the following terms: A certain quantity is 
characterized by a stationary' distribution IV(*P). 
We first make an observation of <t* at a certain 
instant of time / = 0 (say) and again repeat our 

1 This is the translation of the German word 4< Wahr- 
scheinlichkeitsnachwirkung” coined by M. von Smolu¬ 
chowski. 
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observation at a later time t. We ask: What can 
we say about the possible values of <!> which 
we may expect to observe at time / when we 
already know that <t» had a particular value at 
t = 0? It is clear that if the second observation 
were made after a sufficiently long interval of 
time, we should not. in general, expect any 
correlation with the fact that <l> had a particular 
value at a very much earlier epoch. On the other 
hand as t —>0 the values which wc would expect 
to observe on the second occasion will be strongly 
dependent on what we observed on the earlier 
occasion. 

An example considered by Smoluchowski in 
colloid statistics illustrates the nature of the 
problem presented in theories of probability 
after-effects: Suppose we observe by means of an 
ultramicroscope a small well-defined element of 
volume of a colloidal solution and count the 
number of particles in the element at definite 
intervals of time r, 2r, 3r, etc., and record them 
consecutively. We shall further suppose that the 
interval t between successive observations is not 
large. 1 hen the number which is observed on any 
particular occasion will be correlated in a defi¬ 
nite manner with what was observed on the 
immediately preceding occasion. This correla¬ 
tion will depend on a variety of physical factors 
including the viscosity of the medium: thus it is 
clear from general considerations that the more 
viscous the surrounding medium the greater 
will be the correlation in the numbers counted on 
successive occasions. We shall discuss this prob¬ 
lem following Smoluchowski in some detail in 
Chapter III but pass on now to the consideration 
of another example typical of this theory. 

We have already indicated that a fundamental 
problem in stellar dynamics is the specification 
of the distribution function W(F) governing 
the probability of occurrence of a force F per 
unit mass acting on a star. Suppose that F has a 
definite value at a given instant of time. We can 
ask: How long a time should elapse on the 
average before the force acting on the star can 
be expected to have no appreciable correlation 
with the fact of its having had a particular value 
at the earlier epoch? In other words, what is the 
mean life of the state of fluctuation characterized 
by F? In a general way it is clear that this mean 
hfe will depend on the state of stellar motions 


in the neighborhood of the star under considera¬ 
tion in contrast to the probability distribution 
W(F) which depends only on the average number 
of stars per unit volume. I he two examples we 
have cited are typical of the problems which are 
properly in the province of the theory dealing 
with probability after-effects. 

A physical problem, the complete elucidation 
of which requires both the types of theories 
outlined in the preceding paragraphs, is pro¬ 
vided b> Brownian motion. We shall accordingly 
consider certain phases of this theory also. 

CHAPTER I 

THE PROBLEM OF RANDOM FLIGHTS 

The problem of random flights which in its 
most general form we have already formulated in 
the introduction provides an illustrative example 
in reference to which we mnv develop several of 
the principal methods of the theories we wish 
to describe. Accordingly, in this chapter, in 
addition to providing the general solution of the 
problem, wc shall also discuss it from several 
different points of view. 


1. The Simplest One-Dimensional Problem: 

The Problem of Random Walk 

The principal features of the solution of the 
problem of random flights in its most general 
form are disclosed and more clearly understood 
by considering first the following simplest 
version of the problem in one dimension: 

A particle suffers displacements along a 
straight line in the form of a series of steps of 
equal length, each step being taken, either in the 
forward, or in backward direction with equal 
probability After taking N such steps the 
particle could be at any of the points 3 

~ ~ • • •, —l,o, -T 1, • • •, N — 1 and N. 

We ask: What is the probability W{m, N) that 
the particle arrives at the point m after suffering 
N displacements? 

We first remark that in accordance with the 
conditions of the problem each individual step 
is equally likely to be taken either in the back- 


* These can be regarded as the coordinates 
straight line if the unit of length be chosen to be 
the length of a single step. 


along 

equal 


a 

to 
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ward or in the forward direction quite inde¬ 
pendently of the direction of all the preceding 
ones. Hence, all possible sequences of steps each 
taken in a definite direction have the same prob¬ 
ability. In other words, the probability of any 
given sequence of N steps is ($) v . The required 
probability W(m, N) is therefore (§)" times the 
number of distinct sequences of steps which 
will lead to the point m after N steps. But in 
order to arrive at m among the N steps, some 
(N -\-m)/2 steps should have been taken in the 
positive direction and the remaining {N — m)/2 
steps in the negative direction. (Notice that m 
can be even or odd only according as N is even 
or odd.) The number of such distinct sequences 
is clearly 

.V!/[H^+m)]![H^-m)]!. (2) 

Hence 

N\ /1 \** 

W{m,N) = -(-) . (3) 

lHN+m)yU(N-m)y\2/ 


using Stirling’s formula 

log «! = (n-f-j) log n — n 

-H log 2ir+0(n- l )(n —»»). (7) 

Accordingly when N—**> and m<CN we have 


log W(m, TV) —C/V+£) log N 


— $(N+m + 1) log 


— h(N — m+ 1) log 



— £ log 2 t — N log 2. (8) 

But since m«.N we can use the series expansion 

( m\ mm 2 

1 ±— I = dt- +0(m 1 / N*). (9) 

N / N 2N 7 


Equation (8) now becomes 


In terms of the binomial coefficients C,"’s we 
can rewrite Eq. (3) in the form 


W(m, N ) — C(H + m )/2 




in other words we have a Bernoullian distri¬ 
bution. Accordingly, the expectation and the 
mean square deviation of (N+m)/2 are (see 
Appendix I) 


Hence, 


h(N+m)*=lN, 



(m)*, = 0; (m 7 )t, = N. (6) 


The root mean square displacement is there¬ 
fore \/N. 

We return to formula (3): The case of greatest 
interest arises when N is large and m<£N. We 
can then simplify our formula for W(m, N) by 


Table I. The problem of random walk: 
the distribution W(m, N) for N= 10. 


m 

From (3) 

From (12) 

0 

0.24609 

0.252 

2 

0.20508 

0.207 

4 

0.11715 

0.113 

6 

0.04374 

0.042 

8 

0.00977 

0.010 

10 

0 00098 

0.002 


log W(m, N)^(N+l)\ogN-llog2ic-N\og2 

( m m 7 \ 

log N- log 2+-) 

N 2 IP/ 

( m m 2 \ 

log A^ —log 2-). (10) 

N 2N 7 / 

Simplifying the right-hand side of this equation 
we obtain 

log W(m, N)— — \ log A”-Hog 2 

-\\oz2x-m'/2N. (11) 

In other words, for large N we have the asymp¬ 
totic formula 

W(m, N) = (2/wAO* exp (— m , /2N). (12) 

A numerical comparison of the two formulae 
(3) and (12) is made in Table I for A^=10. 
We see that even for A^=10 the asymptotic 
formula gives sufficient accuracy. 

Now, when N is large it is convenient to in¬ 
troduce instead of m the net displacement x from 
the starting point as the variable: 

x = ml (13) 

where l is the length of a step. Further, if we 
consider intervals Ax along the straight line 
which are large compared with the length of a 


J 

K 


j 
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step we can ask the probability W'(jc)Ax that the 
particle is likely to be in the interval x, *4-Ar 
after N displacements. We clearly have 

\V{x, N)Ax = W{m , -V) {Ax/21 ), (14) 

since m can take only even or odd values de¬ 
pending on whether A is even or odd. Combining 
Eqs. (12), (13), and (14) we obtain 

1 

lV(x, AO =-exp ( — x 2 /2Nl l ). (15) 

(2*-AT 2 )* 

Suppose now that the particle suffers n displace¬ 
ments per unit time. Then the probability 
W(x, t)Ax that the particle will find itself between 
x and x T Ax after a time t is given by 

1 

W{x, t)Ax = -exp (~x\/4Dt)Ax, (16) 

2(irDt)l 

where we have written 

D = \nP. (17) 

\\ e shall see in §4 that the solution to the general 

problem of random flights has precisely this 
form. 

2. Random Walk with Reflecting 
and Absorbing Barriers 

In this section we shall continue the discussion 
of the problem of random walk in one dimension 
but with certain restrictions on the motion of 
the particle introduced by the presence of 
reflecting or absorbing walls. We shall first 
consider the influence of a reflecting barrier. 

(a) A Reflecting Barrier at m = m x 

Without loss of generality we can suppose 
t at m,>0. Then, the interposition of the 
reflecting barrier at m i has simply the effect that 
w enever the particle arrives at m x it has a 
probability unity of retracing its step to m x — 1 
w hen it takes the next step. We now ask the 
Probability lV(m, N ; m,) that the particle will 
arrive at m($wi) after N steps. 

For the discussion of this problem it is con¬ 
venient to trace the course of the particle in an 
, m ’ )'Plane as in Fig. 1. In this diagram, the 
displacement of a particle by a step means that 
the representative point moves upward by 



Fig. 1 

one unit while at the same time it suffers a 
lateral displacement also by one unit either in 
the positive or in the negative direction. 

In the absence of a reflecting wall at m = m x the 
probability that the particle arrives at m after 
A steps is of course given by Eq. (3). But the 
presence of the reflecting wall requires W(m, A r ) 
according to (3) to be modified to take account 
of the fact that a path reaching m after n re¬ 
flections must be counted 2” times since at 
each reflection it has a probability unity of 
retracing its step. It is now seen that we can 
take account of the relevant factors by adding to 
W(m, N) the probability W{2m x — m,N) of 
arriving at the “image" point (2 m x -m) after N 
steps (also in the absence of the reflecting wall), 
i.e., 

W{m, N ; m x ) = W(m, N) + \V{2m x -m, N). (18) 

We can verify the truth of this assertion in the 
following manner: Consider first a path like 
OED which has suffered just one reflection at m x . 
By reflecting this path about the vertical line 
through m x we obtain a trajectory leading to the 
image point (2 m x — m) and conversely, for every 
trajectory leading to the image point, having 
crossed the line through m x once, there is exactly 
one which leads to m after a single reflection. 
Thus, instead of counting twice each trajectory 
reflected once, we can add a uniquely defined 
trajectory leading to {2m x — m). Consider next a 
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trajectory like OABCD which leads to m after 
two reflections. A trajectory like this should he 
counted four times. But there arc two trajectories 
C OAB'CD and OABCD') leadi ng to the image 
point and a third ( OAB'CD ) which we should 
exclude on account of the barrier. These three 
additional trajectories together with OABCD 
give exactly four trajectories leading either to m 
or its image 2m\ — m in the absence of the 
reflecting barrier. In this manner the arguments 
can be extended to prove the general validitv 
of (18). 

If we pass to the limit of large N Eq. (18) be¬ 
comes [cf. Eq. (12)] 

IV(m , N: m x ) = ( - \ {exp ( — m 2 /2N) 

\kN/ 

+exp [— (2m, — w) 2 /22V]J. (19) 

Again, if as in §1 we use the net displacement 
x = ml as the variable and consider the prob¬ 
ability W(x, t; Yi)Ay that the particle is between 
x and y + Ay, (Ay»/) after a time t (during 
which time it has taken nt steps) in the presence 
of a reflecting barrier at X\ = nt\l, we have 

1 

W(x, t \ x x ) =- {exp ( -y 2 /4 Dt) 

2(ttD/)* 

+exp [ — (2y,— x)*/4Z>0I- ( 2 °) 

We may note here for future reference that 
according to Eq. (20) 

(dW/d y)*-„ = 0. (21) 

( b ) Absorbing Wall at m = m x 

We shall now consider the case when there 
is a perfectly absorbing barrier at m = m x . The 
interposition of the perfect absorber at m x means 
that whenever the particle arrives at m x it at 
once becomes incapable of suffering further dis¬ 
placements. 4 There are two questions which we 
should like to answer under these circumstances. 
The first is the analog of the problems we have 
considered so far, namely the probability that 
the particle arrives at m(^m,) after taking N 
steps. The second question which is character¬ 
istic of the present problem concerns the average 

* This problem has important applications to other 
physical problems. 


rate at which the particle will deposit itself on 
the absorbing screen. 

Considering first the probability W(m, N; mi), 
it is clear that in counting the number of distinct 
sequences of steps which lead to m we should be 
careful to exclude all sequences which include 
even a single arrival to m x . In other words, if we 
first count all possible sequences which lead to 
m in the absence of the absorbing screen we 
should then exclude a certain number of “ for¬ 
bidden ’ sequences. It is evident, on the other 
hand, that every such forbidden sequence 
uniquely defines another sequence leading to the 
image {2m x — m) of m on the line m = m x in the 
(m, 2V)-plane (see Eig. 1) and conversely. For, 
by reflecting about the line m = m x the part of a 
forbidden trajectory above its last point of con¬ 
tact with the line m = ni\ before arriving at m 
we arc led to a trajectory leading to the image 
point, and conversely for every trajectory 
leading to 2m x — m we necessarily obtain by 
reflection a forbidden trajectory leading to m 
(since any trajectory leading to 2 m x — m must 
necessarily cross the line m = m x ). Hence, 

W(m, N; mi) = W(m, N) — W(2mi — m, N). (22) 

For large N we have 

W(m, N; mi) = (2/xiV)*{exp ( — m*/2N) 

— exp (] — (2m t — m) 2 /2N~\\. (23) 

Similarly, analogous to Eq. (21) we now have 

1 

W(x, t;xi) = -{ exp ( -x*/4Dl) 

2 {irDty 

— exp [ — (2y! — y) 2 /4 Dt~\ j. (24) 

We may further note that according to this 
equation 

W(x lt l;x ,)=0. (25) 

Turning next to our second question concern¬ 
ing the probable rate at which the particle 
deposits itself on the absorbing screen, we may 
first formulate the problem more specifically. 
What we wish to know is simply the probability 
a{m u N) that after taking N steps the particle 
will arrive at m x without ever having touched or 
crossed the line m = m x at any earlier step. 

First of all it is clear that N should have to be 
even or odd depending on whether mi is even 
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or odd. We shall suppose that this is the case. 
Suppose now that there is no absorbing screen. 
T hen the arrival of the particle at m, after N 
steps implies that its position after (A r —1) 
steps must have been either (;«!— 1) or (mi + 1). 
(See Fig. 2.) But every trajectory which arrives 
at (mi, A r ) from (mi-FI, .V — 1) is a forbidden one 
in the presence of the absorbing screen since such 
a trajectory must necessarily have crossed the 
line m = m x . It does not however follow that all 
trajectories arriving at (mi, N) from (mi—1. 
-V—1) are permitted ones: For, a certain number 
of these trajectories will have touched or crossed 
the line m = m , earlier than its last step. The 
number of such trajectories arriving at (mi —1, 
-V—1) but having an earlier contact with, or a 
crossing of, the line m — m x is equal to those 
arriving at (mi-FI, A r —1). The argument is 
simply that by reflection about the line m = m i we 
can uniquely derive from a trajectory leading to 
(mi+1, N —\) another leading to (mi — 1, A r — 1) 
which has a forbidden character, and conversely. 
Thus, the number of permitted ways of arriving 
at m i for the first time after N steps is equal to all 
the possible ways of arriving at m x after N steps 
in the absence of the absorbing wall minus 
twice the number of ways of arriving at (mi-FI, 
A r — 1) again in the absence of the absorbing 
screen: i.e., 

N\ 

[KJV-mOjOtAr + m,)]! 

_ 2 _(A r — 1)! 

[H7V+m,)]0(Ar-m,-2)]! 

~ (TV - m 0] 07 tV -Fm,)]! V 1 ” ) <26) 


__m, N\ 

N [|(A^-m 1 )]![i(Ar-Fm,)57‘ 

The required probability a(rn,. .V) is therefore 
given by 

a ( m », A7)= — N). (27) 

N 

For the limiting case of large N we have 


a(m,, 



exp ( — m x */2N). 


(28) 



If we further write 

= ”»,/; A ’ = «/; D = J nl-, (29) 

where / is the length of each step and n the num¬ 
ber of displacements (assumed constant) which 
the particle suffers in unit time, then 

.v, 1 

a(x\, t) = — — exp ( —.vi s 4/9/). (TO) 

nl (rD/jl 

Finally, if we ask the probability q(x lt t)At that 
the particle arrives at .Vi during t and /-FA/ for 
the first time, then 

q(x i. 0A/ = /)«A/, (31) 

since (30) is the number which arrive at Xi in the 
time taken to traverse two steps. Thus, 

*i 1 

q(xi, () =“■ rr-r— : e «P (,-xr/4Dt). (32) 

l LyirUt)' 

We can interpret F'q. (32) as giving the fraction 
of a large number of particles initially at x = 0 
and which are deposited on the absorbing screen 
per unit time, at time /. 

We readily verify that q{x Xt /) as defined by 
Eq. (32) satisfies the relation 

$(*,. /)= -D(dW/dx)z-x X , (33) 

with W defined as in Eq. (24). This equation has 
an important physical interpretation to which 
we shall draw- attention in §5. 
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3. The General Problem of Random Flights: Markoff’s Method 

I" t ' ,e gcncral r>roblem of random flights, the position R of the particle after N displacements is 
^ ^ ^ ^ y 


X 

t—I 


(34) 

where the r, s (i=l. • -.A) denote the different displacements. Further, the probability that the 
Jth displacement lies between r, and r,-Mr, is given bv 


y„ z i )dx4y>dz l = T t <lr, (t= 1, , N). 


(35) 


We require the probability I V y (R)dR that the position of the particle after N displacements lies in 
the interval R, R + dR. In this general form the problem can be solved by using a method originally 
devised by A. A. Markoff. Now, Markoff’s method is of such extreme generality that it actually 
enables us to solve the first of the two fundamental problems outlined in the introductory section 

W e shall accordingly describe Markoff’s method in a form in which it can readily be applied‘to other 
problems besides that of random flights. 

Let 

<>, = (0>‘. • • •, 0, n ) 0'=L • • •, N) (36) 

be A\ «-dimensional vectors, the components of each of these vectors being functions of j coordinates: 

= * • •, qf) (k=\, • • n; j=\, ■ • N). (37) 


I‘he probability that the q f v s occur in the range 


is given by 
Further, let 


qf 4 -dq *; qf, q?+dq *; • • • ; q/, qf+dqf, 0=1, • • •, N) 
r >0A • • •. qf)dq / • • -dqf = r^q^dq,-. 


X 


(4* 1 , 4> ? , • • •, <!>") = «l» = £ 

The problem is: What is the probability that 

<*>o— \d<t > 0 ^ ‘X> ^ <X» 0 -f- $d<P 0 

where <I>o is some preassigned value for <J». 

If we denote the required probability by 


(38) 

(39) 

(40) 


(41) 


we clearlv have 


H r i v(<I>o)f/4>o I • • d<t > 0 "= IF(<t* 0 )rf<l*o, 


Ws<(*t>o)d<Po = f ■ • • J n [t iiqi)dqi\, 


(42) 


(43) 


where the integration is effected over only those parts of the Afo-dimcnsional configuration space 
(< 7 i*, • • •, q\-‘) in which the inequalities (41) are satisfied. 

We shall now introduce a factor A(q u • • •, q N ) having the following properties: 


Then, 


A(q i, •••,qs) = 1 whenever <t» 0 — + 

= 0 otherwise. 

Y 

&(q i. ’■ .qy) IT lrj(qj)dqj) 

i-i 


\Vs (*t*o)d «I»o = J* • • * J ■ 


(44) 


* 




(45) 
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where, in contrast to (43), the integration is now extended over all the accessible regions of the con¬ 
figuration space. The introduction of the factor A under the integral sign in Eq. (45) in this manner 
appears at first sight as a very formal device to extend the range of integration over the entire con¬ 
figuration space. But the essence of Markoff’s method is that an explicit expression for this factor can 
be given. 

Consider the integrals 

1 r + * sin a k fik 

5fc = - I -exp (ipk't k)dp k {k = \ ,•••,»). (46) 

*■ Pk 

I he integral defining is the well-known discontinuous integral of Dirichlet and has the property 


Now, let 


5*=1 whenever — a*< 7 *.•<«*, 
= 0 otherwise. 


V 


According to Eq. (47) 


«* = $</«*> 0 *; 7 * = Y. <t>j k — 4> 0 * 1 k = 1 . •••,>/). 

>-» 


5* = 1 whenever ‘ho 4 - Jrf4> 0 * < E <t>,* < 4> u * -f $r/4>„*, 

1 


Consequently 


= 0 otherwise. 


(47) 


(48) 


(49) 


a— n 5 t 

k-l 

has the required properties ( 44 ). 

Substituting for A from Eqs. (46) and (50) in Eq. (45), we obtain 


WM<t>oM<*»o = 




] I JL sin (|d4>o*P*) 
p* 


Xexp | E 0 /p*-I: 4> 0 *p*J 


>r/ 


Pi 




n—.n 


If 


exp (-z'p 4» 0 )^l.v(p)f/p 


where we have written 


*<*)- n /•••JW" CX P (lp#,)r, (g/, • • - , ?/ ). 


(50) 


dp 


(51) 


(52) 


tion Ts7) theTbe'ctJ T*" “ ^ fUnCti ° nS ( ° f ^ reSpeCtive * /s) are **"*«!. Eq 


ua- 


= exp (ip- #)r(< 7 )d^j . 


(53) 


Accordmg to Eq. (SI). A N { 9 ) is the ^-dimensional Fourier-transform of the probability function 
- T 0) - K K a f 3 PrOCedure illustratcs a vcr y general principle that it is the Four er transform 
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For iV—* x , .4 v (p) generally tends to the form [see §4 Eq. (91)] 

Limit As (p) = exp [ — C(p)]. 


.V-# 9 C 


(54) 


4. The Solution to the General Problem of Random Flights 


We shall now apply Markoff's method to the problem of random flights. According to Eqs. ( 34 ). 
(51). and (52). the probability \V s {R)dR that the position R of the particle will be found in the 
interval (R R-\-dR) after .V displacements is given by 


where 


1 r +x 

W\(R) = — I exp ( — ig-R)A\- 

8tt 3 v— s 


(p)dp, 


(55) 


.V /.+* 

^.v(e) = n I T,(r,) exp (t'p• r,)rfr>. 

J _ 


(56) 


In Eq. (55). r,(r,) governs the probability of occurrence of a displacement r, on the 7 th occasion. 
1 he explicit form which W\(R) takes will naturally depend on the assumptions made concerning the 
r,(r,)'s. We shall now consider several cases of interest. 

(a) A Gaussian Distribution of the Displacements r,- 
A case of special interest arises when 


1 


T > = 


(2 W,-Y3)« 


exp (— 31 r,| 2 / 2 /, 2 ), 


(57) 


where If denotes the mean square displacement to be expected on the _/th occasion. While /, 2 may differ 
from one displacement to another we assume that all the displacements occur in random directions. 
For r, of the form (57). our expression for A\(p) becomes 


.v 


1 


+ OC 


A ,v(p) = II 


;-t (2irlf/3) 


•Iff exp [tfpiAry+Piyy+Psz,) — 3(xf+yf+zf)/2lf']dx/iy/iz i 


— ac 


(58) 


= 11 exp [ — (pi*-Fpi* + Ps 2 )/,V6] = exp [ — ( o 2 £ //)/6]. 

;-l 1 


Let </ 2 )*, stand for 


Equation (58) becomes 


</%=- i: if. 

N /-1 

A\(g) = exp [ — A^/ 2 )*, | p | */ 6 ]. 


(59) 


(60) 


Substituting this expression for 4.v(p) in Eq. (55), we obtain 

+ *> 


WM/?)=-^ J J J exp [-t(p 1 X+p l K+p^)-/V</ 2 > 4 .(p, 2 +p 2 *+P 3 2 )/ 6 ]dp,dp 2 < /p; 


( 61 ) 


— 00 


The integrations in (61) are readily performed and we find 


Ws(R) = 


1 


(2 7 rA^(/ 2 )*./3) 


exp [ — 31 /? 1 2 /2/V(/ 2 )*,]. 


(62) 
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This is an exact solution valid for any value of N. That an exact solution can be found for a Gaussian 
distribution of the different displacements is simply a consequence of the "addition theorem" which 
these functions satisfy. 

(b) Each Displacement of a Constant Length But in Random Directions 

Let the displacement on the 7 th occasion be of length /, in a random direction. I 'nder these circum¬ 
stances. we can define the distribution functions t , by 


Tj= -6( f/i*-/,-*). 0=1. 

4 t/, j 


. N) 


where 5 stands for Dirac’s b function. 

Accordingly, our expression for /l.vio) becomes 

V 1 r -*-* 


'Mp) = II - f exp (i'p •r,)b[r J i —l f)dr,, 

>-l 4W;* J _* 


or, using polar coordinates with the 2 axis in the direction of 0 


v 1 r r T r 

^v(p) = II - I I I exp ft p r, cos r?]5(r/ 2 — /, 2 )r, 2 sin ddr,ddd<j>. 

t-\ Atrl , 3 J 0 J 0 J 0 

The integrations over the polar and the azimuthal angles 0 and w are readily effected : 

v 1 r* r' 

^lx'(p) = II— I I exp (i|p;r, cos tf)r,*5(r, 3 — /,■*) sin ddddrj 
/-* 2 If J 0 

= n-— f Sin dpi r ,)r ~ 1 ?)dr, 

>-'l? Ip. J 0 


Thus, 


_ ^ sin (l e |/, ) 

;-l p|/y 


1 f + " v s > n (I p I /;) 

\s(R) = - exp ( — ip-/?) n - d e . 

8ir 3 J * 1-1 I p | /, 


(63) 


(64) 


(65) 


( 66 ) 


(67) 


Again, choosing polar coordinates but with the 2 axis pointing this time in the direction of R, 
we have 

1 r* r+ l r 2 ' ( -v sin de|/,) 

WM#)=— I I I exp (-1 p 1 \R /)| FI -;- \g\ 2 dwdtd\ 9 \. (68) 

8ir J 0 •'-i ^0 l *-* i p | /> 

The integrations over u> and t are readily performed and we obtain 


Wn{R)= VT^ 7 f sin del 1 * 1)1 n 

2 t 2 |/?| ^0 11-1 


" sin del/,) 


I p u> 


pl rf lp 


(69) 


which represents the formal solution to the problem. In this form, the solution for the problem of 
random flights is due to Rayleigh . 4 


rhl a°n^r^| a ^ lei K| h ' Col / ecte< ^ Pa Pf rs . Vol. 6, p. 604. We may, however, draw attention to t 

s ^„ 8 ds Yo iJr 8 iS Wi,tr in ltS * COpe than Rayleigh ' 5 - Raylei 8 h ' s <« 


o the fact that our formulation of 
formulation of the problem corre- 
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The case of greatest interest arises when all the Z/s are equal. We shall assume that this is the case 
m the rest of our discussion : 


lj = l = constant (j= 1, •••,2V) 


Equation (69) becomes 


(70) 




!) 


sin (|p|/) 


9\l 




pl<*|p 


(71) 


(t) N finite.—We shall illustrate (following Rayleigh) the method of evaluating the integral on the 
right-hand side of Eq. (71) for finite values of N by considering the cases N = 3 and 4. 

When A r =3, Eq. (71) becomes 


sin( ie ||*|)sin>(l P |Z)^. (72) 

But 

sin ( p||/?|) sin 3 (| p! /) = \ |3 cos [(| R\ -/) | p| ]-3 cos [(| |p| ]-cos [(| R\ -31) |p| ] 

P . +cos[([/?|+3/)|p|]}. (73) 

r urther 



d (p| 

{cos [(|/?| -/)|p|]-cos [(|/?| +/)le |]|—— 

lei 2 


, r\ • (i^i+^ipi ., (i7?i-/)i e i)rfipi 

J o l 2 2 /1P | 2 


J 


(74) 


We have a similar formula for the integral involving the other pair of cosines in Eq. (73). Combining 
these results we obtain 


W>(R) = 32 J ] -- \ li \ 2 \R\-3\\R\-l\ + \\R\-3l\), 

or, more explicitly 

1 

W 3 (R)= - (0 < | /? | </), 

8 7r/ 3 

- — ■ , p , (3| - |/?| ) (/< |/?l <3/). 

16*7*1 RI 

= 0 (3/< |/?| < oo). 


(75) 



(76) 


We shall consider next the case N=4. According to Eq. (71) we have 


1 

W<(R) = - 

2x*|/?|/< 



sin (|p| |/?|) sin 4 (|p|/). 


(77) 


From this equation we derive 
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(P 1 r 

- [\R\W<(R)~} = - I 

d|*i s 2x V*J 0 


d\9 


sin (!p| 1 *!) sin 4 dpi/) 


1 (•* d | p i 

=--|sin[(|/?H-4/)|e|] + sin[(|/?|-4/)|el] 

32t'1*J 0 |p| 

-4 sin [(! *' + 2/) | p| J — 4 sin [( | R\ - 21) | p| ] + 6 sin (!*! |p|)| 

1 1 

-(ldtl -44=44-6) =-(3±1=F4), 


64x1* 


64x1 


(78) 


where the two alternatives in the last two steps of Eq. (78) depend, respectively, on the signs of 
(\R\-41) and (|*| -21). Thus 


64x1* 


d‘ 


d \ R - 


l\R\ HV*)]=-6 (0 < j * < 21), 


= 4-2 (21 <\R\ <4l), 

= 0 (4/< \R\ < oo). 


(79) 


We can integrate the foregoing equation working backwards from large values of R where all 
derivatives must vanish. We find 


64x1* -[(/?! W\(tf)] = 2(|/?|-4/) (21 < R < 41), 


d I R 


= — 61 i? | 4-8/ (0 < | /? | <2l), 


(80) 


where we have used the continuity of the quantity on the left-hand side of this equation at | R\ = 21 
Integrating Eq. (80) once again we similarly obtain 


and 


Thus, finally 


\(2l < R <4 /). 


64xl*\R\W<(R)= |/?| 2 -8/|/?! 4-16/* 

= (4l-\R\y 


64xl*\R\W<(R)= -3i/?! 2 4-8/|/?|(2/> \R\ >0). 


W<(R) = 


1 


64ir/ 4 1 R | 
1 

64x1* I R 


(8I|*|-3|JI|*) (0< |/?| < 21), 


(4/-|*|)’ 


= 0 


(2/ < | * i <4/), 
(4/ < |*| < ao ). 


(81) 


(82) 


(83) 


!n like manner it is possible, in principle, to evaluate the integral for W„(R) for any finite value of 

N. But the calculations become very tedious. We may however note the following solution obtained 
by Rayleigh for the case 2V = 6. 
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=——-_- ( x 6 P m _4/[*|3 + (5 / 6)|*|. ) 


(0<R < 21) 


^-p^ 7< ( -2 0 /*+S6/»|/ J |-3( ) P|/f|*+6/|*|*-(5/12)|«|<) (2/<|tf|<4/) 
1 

2^!^° 08/4 " 72/3!/?l+18/ ' :|/?|2 " 2/!i?|, + (1/12),/?,,) (*'<1*1 < 6 ') 


(84) 


= 0 (6/< |/?| < oo).J 

(ii) X« 1. By far the most interesting case is when :V is very large. Under these circumstances 


. /sin (|p|/)\ A ' 

L,m,t ( —TTT - ) = Limit (1 -£Ip! 2 / 2 +- • -) v , 

•V-*ao V . Ip 1 / / , v -» 


= exp ( —iV|p| 2 / 2 /6). 

Accordingly, from Eq. (69) we conclude that for large values of N 


(85) 


1 r x 

W{R) = 2^[R\ J 0 cx P (-A75 lpl 2 / 6 )!p| sin (| R\ | p| )d\ 9 1, 


( 86 ) 


where we have written W{R) for IT.v(7?), N—*x. Evaluating the integral on the right-hand side of 
Eq. (86), we find 


W(R) = 


1 


(2t/W73)« 


exp ( — 31 R\ 2 /2Nr-). 


(87) 


We notice the formal similarity of Eqs. (62) and (87). However, on our present assumptions, Eq. (87) 
is valid only for large values of N. 


( c ) A Spherical Distribution of the Displacements. 7V» 1 
We shall assume that 

r,(r y ) = r(|r,|*) 0=1. •••.TV). 

AA9) = [/_*' exp (ip»r)r(r 5 )<ir 


Then 


]' 


( 88 ) 


(89) 


By using polar coordinates, the integral inside the square brackets in Eq. (89) becomes 

r* r +I r v r*sin(|p|r) 

| exp (tpT)r(r 2 )<fr = III exp (i p rt)r 2 r(r 3 )doxltdr = 4x I - r 3 r(r 3 )dr 

J 0 J-i Jo Jo |p|r 


(90) 


Hence 


Limit Av(p) 

iV-*CD 


= Limit \Air f 
L J 0 


CO 


sin (| p | r) ** Ar 

- r 3 r(r 3 )dr 


9\r 




= LimitF47rr (1 — £ | p 1 2 r 2 -f- • • • )r 2 r(r 2 )</rl , 

N—x I- J o J 


= ex P*( “ TV | p 1 2 <r 2 )*,/o) 


(91) 
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where (r 1 )*, is the mean square displacement to be expected on any occasion. Substituting the fore¬ 
going result in Eq. (55) we obtain 


W(R) 


1 r +x 

= -I exp ( — ip»/? — iV|p| : (r 2 )*,/6)</y, 

8» a 


(92) 


or, [cf. Eq. (62)] 


1 


H 7 i/?)=- — exp (' — 31?:- 2iV<r%). 

(2 xA'(r%/3)« 


(93) 


Ii is seen that Eq. (93) includes the result obtained earlier in Section (b) under case i.ii> Eq. (87)] 
as a special case. 

f d) The Solution to the General Problem of Random Flights for ,V»1 

We shall now obtain the general expression for W'\{R) for large values of .V with no special as¬ 
sumptions concerning the distribution of the different displacements except that all the r/s represent 
the same function. Accordingly, we have to examine quite generally the behavior for N —► » of 
/4v(p) defined by [cf. Eq. (53)] 

.v 


A v (p) 


=[/:.» 


exp ( ig»r)T(r)dr 




(94) 


Let pi, p 2 , p-s denote the components of p in some fixed system of coordinates. I hen 
Av(q) = exp [i(pi* + P 2 .y + p3z)]7-(x, y, z)</jrc/yrfzj . 

J J* 11+»(pix +pjy + p*2) — h(pi 1 x 1 + pi : y 2 + fti l Z’ + 2p l pixy 


4 -2p 2 pj>-s4-2p 3 pi2A-) 4- • • • I r(x, y, z)dxdyd 


l v 

:dydz , 


(95) 


= [ 1 + t(pi(x)-f p 2 (y> + P3<z» — ^ (p , 5 (x J ) + p 2 -(y 2 )-f P3*<z l ) + 2p ip 2 (x>-> 

4- 2p 2 p 3 (yz) 4- 2p 3 p t (zx)) -f • • • ]* 

where (x), • • •, (zx) denote the various first and second moments of the function r(x, y, z ). Hence 
for N —► ao we have 

A*(p)=exp [iW(p,(x) + p 3 (y) + p 3 (z)) - %A r ()(p)] (96) 

where Q( p) stands for the homogeneous quadratic form 


Q(q) = (X s ) P r 4- (y 2 )p2 2 4- (z 2 W 4- 2 (xy)p ,p 2 4- 2 (yz)p : p 3 4- 2(zx)p 3 pi. 


(97) 


Substituting for 4.v(p) from Eq. (96) in Eq. (55) we obtain for the probability distribution for 
large values of N the expression : 

1 /•+» -+» 

W{R) = T~ 3 J J I exp [ - \NQ( p) -i\pi(X- N(x)) 4-p 2 ( Y— N(y)) 4 -p 3 (Z - N(z)) } ~]d Pl d P2 dp 3 . 

ox — (98) 

To evaluate this integral we first rotate our coordinate system to bring the quadratic form Q(o) 
to its diagonal form. 


Q(q) = (Dpi*+<» 7 t W4-<f 2 >Pf 2 . 


(99) 
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In Eq. (99) (£ 2 ), (rj-) and (f 2 ) are the eigenvalues of the symmetric matrix formed by the second 
moments: 


<* 2 > 

(xy) 

(xz) 

<y*> 

(y 2 ) 

(yz) 

(zx) 

(zy) 

<z 2 > 


( 100 ) 


Further, the three eigenvectors of the matrix (100) form an orthogonal system which we have 
denoted by (£, 77, f). Let 

R= (H, H, Z) (101) 


in this system of coordinates. Equation (98) now reduces to 


W(R)= — 

8tt 3 



exp [-liV((^)pr + <i? J >p, 2 + (fV) 


i[p ( (Z-N^))+p,(H-N( n ))+p { (Z-N(i:))\yip f dp i dp [ . (102) 


The integrations over p£, p, and p f are now readily performed, and we find 


W(R) = 


1 


(8 


exp 


i- 


(H-AW (II A^(t;)) 2 (Z -AW) 2 


2AT<?> 


2A^(?j 2 ) 


2 aw 


] 


003) 


According to Eq. (103), the probability distribution W(R) of the position R of the particle after 
suffering a large number of displacements (governed by a basic distribution function t[_x, y, z]) 
is an ellipsoidal distribution centered at (N(£), N(n), N ({))—in other words the particle suffers an 
average systematic net displacement of amount (N(£), N(rj), N(t)) and superposed on this a general 
random distribution. 

The principal axes of this ellipsoidal distribution are along the principal directions of the moment- 
ellipsoid defined by (100) and the mean square net displacements about (#(£), N( v ), N({)) along the 
three principal directions are 


<c~ - = N (?); ((H - N( v m* = NW ); <(Z - A^)) 2 )* = AW- (104) 


5. The Passage to a Differential Equation: The Reduction of the Problem of Random 

Flights for Large N to a Boundary Value Problem 

In the preceding sections we have obtained the solution to the problem of random flights under 
various conditions. Though in each case the problem was first formulated and solved for a finite 
number of displacements, the greatest interest is attached to the limiting form of the solutions for 
large values of N. And, for large values of N the solutions invariably take very simple forms. Thus, 
according to Eq. (93) a particle starting from the origin and suffering n displacements per unit time, 
each displacement r being governed by a probability distribution r(|r| 2 ), will find itself in the ele¬ 
ment of volume defined by R and R-\-dR after a time t with the probability 

1 

W(R)dR = -exp (— 31 /? | 2 / 2n(r 2 )*t)dR. (105) 

(2tt «<r 2 >*//3)» 

In the foregoing equation (r 2 )*, denotes the mean square displacement that is to be expected on any 
given occasion. If we put 

D = nit 2 )*,/ 6 (106) 

Eq. (105) takes the form [cf. Eq. (16)3 

W(R)dR = - - -exp (-|/?| 2 /4D/)dR. (107) 

(4 irDty 


STOCHASTIC PROBLEMS IN PHYSICS AND ASTRON O M Y 


17 


In view of the simplicity of this and the other solutions, the question now arises whether we can¬ 
not obtain the asymptotic distributions directly, without passing to the limit of large jV, in each 
case, individually. This problem is of particular importance when restrictions on the motion of the 
particle in the form of reflecting and absorbing barriers are introduced. Our discussion in §2 of the 
simple problem of random walk in one dimension with such restrictions already indicates how very 
complicated the method of enumeration must become under even somewhat more general conditions 
than those contemplated in §2. The fact, however, that for the solutions obtained in §2, \V vanishes on 
an absorbing wall [Eq. (25)] while grad W vanishes on a reflecting wall [Eq. (21)] suggests that the 
solutions perhaps correspond to solving a partial differential equation with appropriate boundary 
conditions. We shall now show how this passage to a differential equation and a boundary value 
problem is to be achieved. 

hirst, we shall introduce a somewhat different language from that we have used so far in discussing 
the problem of random flights. Up to the present we have spoken of a single particle suffering dis¬ 
placements according to a given probability law, and asking for the probability of finding this 
particle in some given element of volume at a later time. It is clear that we can instead imagine a 
very large number of particles starting under the same initial conditions and undergoing the dis¬ 
placements without any mutual interference, and ask the fraction of the original number which will 
be found in a given element of volume at a later time. On this picture, the interpretation of the 
quantity on the right-hand side of Eq. (106) is that it represents the fraction of a large number of 
particles which will be found between R and R-\-dR at time / if all the particles started from R = 0 
at / = 0. However, the two methods of interpretation are fully equivalent and we shall adopt the 
language of whichever of the two happens to be more convenient. 

We pass on to considerations which lead to a differential equation for W{R, i ): 

Let A/ denote an interval of time long enough for a particle to suffer a large number of displace¬ 
ments but still short enough for the net mean square increment (|A/?; 2 )* in R to be small. Under 
these circumstances, the probability that a particle suffers a net displacement A R in time A/ is given by 

1 

«A(A/?; A/) = — _ - exp (- | A/? | */4 DM) (108) 

ytlcLt&t ) 1 

and is independent of R With A/ chosen in this manner, we seek to derive the probability distribution 

W{R, /-fA/) at time / + A/ from the distribution W{R, l) at the earlier time /. In view of (108) and 
its independence of R we have the integral equation 


r +x 

W(R, / + A/) = J iy(/?-A/?, t)i(AR-M)d(AR). 


(109) 


Since <|AK|*>„ i s assumed to be small we can expand W^R-Afl, t) under the integral sign in (109) 
in a Taylor series and integrate term by term. We find 


mR ' t+M)= ^D^L £ r~ 


(4irDA/) 

dW 1 

H- 
dZ 2 


dW dW 

W{R, t) -AX-AT- 

dX dY 


d 2 W d 2 W d 2 W d 2 W 

-AZ-+ - (A*)*—- + (AK) 2 — -H(AZ) 2 - 


dX 2 


dY 2 


dZ 2 


+ 2AATA T- 


dXdY 


d 2 W d 2 W 1 

+ 2A KAZ -+ 2AZAX-- N- \d(*X)d(± Y)d(AZ) 


> (HO) 


OYdZ 


dZdX J 


/ d 2 W d 2 W a 2 fT\ 

= W(R, 0+DAl(—)+0 ([ A09. 


\ dX 2 d Y 2 dZ 2 
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Accordingly, 


dW / d-W 

-A/ + 0([A/J)*'0(-+ 

dt \ dX- 


d-W 

-(~ 

dY 2 



A/ + 0([A/]*). 


Passing now to the limit of A/ = 0 we obtain 


dW / d 2 W 

— = D{ -+ 

dt \ dX 2 


d-W 

-b 

dY 2 



( 111 ) 


( 112 ) 


which is the required differential equation. And, it is seen that W{R, t) defined according to Eq. (107) 
is indeed the fundamental solution of this differential equation. 

Equation (112) is the standard form of the equation of diffusion or of heat conduction. This analogy 
that exists between our differential Eq. (112) to the equation of diffusion provides a new interpreta¬ 
tion of the problem of random flights in terms of a diffusion coefficient D. 

It is well known that in the macroscopic theory of diffusion if W(R, t) denotes the concentration of 
the diffusing substance at R and at time /, then the amount crossing an area A<7 in time A t is given by 

— D(\± 0 *grad PF)A<rA/, (113) 

where 1^, is a unit vector normal to the element of area Aa. The diffusion equation is an elementary 
consequence of this fact. Consequently, we may describe the motion of a large number of particles 
describing random flights without mutual interference as a process of diffusion with the diffusion 
coefficient 

D = n<r 2 >Af/6. (114) 

With this visualization of the problem, the boundary conditions 

W=0 on an element of surface which is a perfect absorber (115) 

and 

grad 1^=0 normal to an element surface which is a perfect reflector (116) 

become intelligible. Further, according to Eq. (113), the rate at which particles appear on an absorb¬ 
ing screen per unit area, and per unit time, is given by 

— D{\ *grad W)w -o (117) 

where 1 is a unit vector normal to the absorbing surface. This is in agreement with Eq. (33). 

We shall now derive the differential equation for the problem of random flights in its general form 
considered in §4, subsection (d). This problem differs from the one we have just considered in that 
the probability distribution r(r) governing the individual displacements r is now a function with no 
special symmetry properties. Accordingly, the first moments of r cannot be assumed to vanish; 
further, the second moments define a general symmetric tensor of the second rank. Under these 
circumstances, the probability of finding the particle between R and R-\-dR after it has suffered a 
large number of displacements is given by [cf. Eq. (103)] 


W(R)dR = 


1 


(8 *W<**><y*><tf»» 


exp £- 


(. X-N(x)y ( Y—N{y)Y (Z-N(z)Y -1 

\dR. 


2N(x-) 


2 NW 


• 2N{z-) J 


(118) 


In writing the probability distribution IF(/?) in this form we have supposed that the coordinate 
system has been so chosen that the X, 1’, and Z directions are along the principal axes of the moment 
ellipsoid. 

Assuming that, on the average, the particle suffers n displacements per unit time we can rewrite 
our expression for W{R) more conveniently in the form 
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1 


W(R) = 


where we have written 


8(xf) b0,0 2 0,)» 


exp 


[- 


(AT-+-/3,/)* (F-M*/) 2 (Z + tf,/) 2 ! 


4 O,/ 


4 D,l 


40,/ 


119) 


( 120 ) 


D 1 = h n (x 7 ); D-i = \n (V- >; O 3 = }« \z‘), 

0 1 = — «<.r); 0 i= - n{y ); 0 3 = ~ n(z). 

To make the passage to a differential equation, we consider, as before, an interval A/ which i s 
long enough for the particle to suffer a large number of individual displacements but short enough fo r 
the mean square increment ( A/? 2 >*, to be small. The probability that the particle suffers an incre¬ 
ment A/? in the interval A/ is therefore governed b\ the distribution function 


*(A R: A/) = 


1 


8(tA/)»(Z)»D,D 3 ) 


exp 


(AX + 0.A/) 2 (AK+j3,A/) J (AZ+ /3jA/) 2 


40,A/ 


4/9.. A/ 


40, A/ 


(121) 


Hence, analogous to Kqs. (109) and (110) we now hav< 


W<R 


dW r + ' 

,t + U)=W(R,t)A -A/ + 0([A/] 2 ) = WIR-&R, Oi/dAfl; A/k/<A/?) 

a/ J . 


1 


— / 


J W *./)-( 


8(tA/)»(0i0 2 D 3 ) 

(AZ + /3,A0 2 
40jA/ 


(AX 4-/3,A/) 2 (AF+£,A/) a 

40,A/ 40 2 A/ 


a H’ a IT a IT 

AX-|-AF-TAZ 

ax a F 


a w \ 
az/ 


k 


a 2 it a 2 it a 2 it a 2 it a 2 it 

+ 1 AX 2 -+ A F 2 -+ AZ 2 -+ 2AXA Y --4- 2A FAZ 

ax 2 dY- az 2 axaF aFaz 


Since for the distribution function (121) 


a -’PT \ 

+ 2AZAX- \ 


azax 


)J(AXM(AF)d(AZ). 

J 


> 022 ) 


and 


(AX)*,= — 0iAt; (A F)«, = — 0 2 A/; (AZ>*,= — /3 a A/, 


023) 


<AX% = 20,A/ + ,3, 2 A/ 2 
(A F 2 )a, = 20 2 A/ + /3 2 5 A/ 2 
(AZ 2 )m = 20 3 A/ -T 0y±f- 
we conclude from Eq. (122) that 

—-A/ + 0([A/] 2 ) = ( 0 t -+ 0, + 0 a -)AH-( O 

dl V ax aF az/ V 

1 assing now to the limit A/ = 0 we obtain 


(A FAZ)*, = 0203&1 7 , 
(AZAX)*. = a3a»A/ 2 . 
(AXA F)*, = 0i02^t-, 


(124) 


a 2 ir a 2 ir a 2 PT\ 

‘ 1-^2-t-Os- IA/ + 0([A/] 2 ). 


ax 2 


aF 2 


az 2 / 


(125) 


avr 

at ax 


aw aw aw a 2 w a 2 w a 2 w 

= 0 i -hfo— + 03 -l-O,- 1 -o 2 -f-O a —, 


aF 


az 


ax 2 


dY 2 


az 2 


(126) 


which is the required differential equation. According to this equation we can describe the phe¬ 
nomenon under d.scussron as a general process of diffusion in which the number of partides crossing 
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elements of area normal to the X, V, and Z direction per unit area and per unit time are given 
respectively, by ’ 

dW dW 


-fiiW-Dx -; -0 2 W-D 2 -; -faW-Dt 


dW 


dX 


dY 


dZ 


(127) 


For the purposes of solving the differential Eq. (126) it is convenient to introduce a change in the 
independent variable. Let 


W = U exp I" — ~~(X — X 0 ) — Y — Yo)--(Z-Zo)-—t -—/-—/]. 

L 2 D x 2D 2 2D 3 4 D x 4 D 2 4 D 3 J 


We verify that Eq. (126) now reduces to 


dU d 2 U d 2 U d 2 U 

— D\ - \-D 2 -f -Dz -. 


dt 


dX 2 dY 2 


dZ 2 


The fundamental solution of this differential equation is 


U 


Constant f 

=-exp - 

(. D x D 2 D j/ 3 )* L 


(X-Xo y (Y-Yo) 2 (Z-Z 0 ) 2 


(D\D 2 D 3 t 3 ) 


4 D x t 


4D 2 t 


4D 3 t 


] 


Returning to the variable W, we have 


W = 


Constant 
C D,D 2 D 3 t J ) 


-exp - 


(X-Xo+M 2 (Y- Yo + M 2 (Z-Zo + M 2 


4 Dyt 


4D 2 t 


AD 3 t 


] 


028) 


(129) 


(130) 


(131) 


In other words, the distribution (119) does indeed represent the fundamental solution of the differ¬ 
ential Eq. (126). 


CHAPTER n 

THE THEORY OF THE BROWNIAN MOTION 
1. Introductory Remarks. Langevin’s Equation 

In the studies on Brownian motion we are principally concerned with the perpetual irregular 
motions exhibited by small grains or particles of colloidal size immersed in a fluid. As is now well 
known, we witness in Brownian movement the phenomenon of molecular agitation on a reduced scale 
by particles very large on the molecular scale—so large in fact as to be readily visible in an ultra¬ 
microscope. The perpetual motions of the Brownian particles are maintained by fluctuations in the 
collisions with the molecules of the surrounding fluid. Under normal conditions, in a liquid, a Brown¬ 
ian particle will suffer about 10 21 collisions per second and this is so frequent that we cannot really 
speak of separate collisions. Also, since each collision can be thought of as producing a kink in the 
path of the particle, it follows that we cannot hope to follow the path in any detail—indeed, to our 
senses the details of the path are impossibly fine. 

The modern theory of the Brownian motion of a free particle (i.e., in the absence of an external 
field of force) generally starts with Langevin's equation 

du/dt= — 0u+ A(t), (132) 

where u denotes the velocity of the particle. According to this equation, the influence of the surround¬ 
ing medium on the motion of the particle can be split up into two parts: first, a systematic part 
— 0u representing a dynamical friction experienced by the particle and second, a fluctuating part A(t) 
which is characteristic of the Brownian motion. 
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Regarding the frictional term — du it is assumed that this is governed by Stokes’ law which states 
that the frictional force decelerating a spherical particle of radius a and mass m is given by (ixa^u/tn 
where rj denotes the coefficient of viscosity of the surrounding fluid. Hence 

0 ~ 6tt<3 t]/ m. (133) 

As for the fluctuating part Aft) the following principal assumptions are made: 
fi) Aft) is independent of u. 

(ii) Aft) varies extremely rapidly compared to the variations of u. 

The second assumption implies that time intervals of duration St exist such that during St the 
variations in u that are to be expected are very small indeed while during the same interval Aft) may 
undergo several fluctuations. Alternatively, we may say that though u(t) and u(/ + A/) are expected to 
differ by a negligible amount, no correlation between An) and A(t + St) exists. (The assumptions 
which are made here are quite analogous to those made in Chapter 1, §5 in the passage to the differ¬ 
ential equation for the problem of random flights; also see §§2 and 4 in this chapter.) 

We shall show in the following sections how with the assumptions made in the foregoing para¬ 
graphs. we can derive from Langevin s equation all the physically significant relations concerning 
the motions of the Brownian particles. But we should draw attention even at this stage to the very 
drastic nature of assumptions implicit in the very writing of an equation of the form (132). For we 
have in reality supposed that we can divide the phenomenon into two parts, one in which the dis¬ 
continuity of the events taking place is essential while in the other it is trivial and can be ignored. 
In view of the discontinuities in all matter and all events, this is a prima facie, an ad-hoc assumption! 

I hey are however made with reliance on physical intuition and the aposteriori justification by the 
success of the hypothesis. However, the correct procedure would be to treat the phenomenon in its 
entirety without appealing to the laws of continuous physics except insofar as they can be explicitly 
justified. As we shall see in ( hapter IV a problem which occurs in stellar dynamics appears to provide 
a model in which the rigorous procedure can be explicitly followed. 

2. The Theory of the Brownian Motion of a Free Particle 

Our problem is to solve the stochastic differential equation (132) subject to the restrictions on Aft) 
stated in the preceding section. But ‘•solving" a stochastic differential equation like (132) is not the 
same thing as solving any ordinary differential equation. For one thing, Eq. (132) involves the func- 
tion Aft)^ which, as we shall presently see, has only statistically defined properties. Consequently. 

solving the Langevin Eq. (132) has to be understood rather in the sense of specifying a probabilitv 
distribution W(u,t\u 0 ) which governs the probability of occurrence of the velocity u at time t 
given that u = u 0 at / = (). Of this function Wfu, /; u 0 ) we should clearly require that, as t-* 0. 

Wfu, l; u 0 )—>6(u z -u t .o)&(u y -u v ,o)6(u,-u t . 0 ) ft— > 0 ), ( 134 ) 

wedemand of r m' r T 5 \ fu , nCtions ' F J urther ' the Physical circumstances of the problem require that 
surrounding ^ ^ ^ ° f *he 


Wfu, t\ u 0 ) 


( 


m \ I 

) exp (-w|u|72fc T) (/—♦»). 


(135) 


For'IccorZrto th “ o) conversel y rec I uires that MO satisfy certain statistical requirements 

1 or, according to the Langevin equation we have the formal solution 

u-Uoe~ fi, = e-^J e*lAft)dt. 


( 136 ) 
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Consequently, the statistical properties of 


must be the same as those of 


.-d 


u — u 0 e-* 1 


‘f 


And, as t »=c the quantity (137) tends to u\ hence the distribution of 


(137) 

(138) 


Limit 

(-♦X 


f r‘ ) 

| e-'J e et A(()d( | 


(139) 


must be the Maxwellian distribution 

(m/2irkT)* exp ( — m \u\*/2kT). (140) 

Now one of our principal assumptions concerning A(t) is that it varies extremely rapidly com¬ 
pared to any of the other quantities which enter into our discussion. Further, the fluctuating ac¬ 
celeration experienced by the Brownian particles is statistical in character in the sense that Brownian 
particles having the same initial coordinates and/or velocities will suffer accelerations which will differ 
from particle to particle both in magnitude and in their dependence on time. However, on account 
of the rapidity of these fluctuations, we can always divide an interval of time which is long enough 
for any of the physical parameters like the position or the velocity of a Brownian particle to change 
appreciably, into a very large number of subintervals of duration A/ such that during each of these 
subintervals we can treat all functions of time except A(t) which enter in our formulae as constants. 
Thus, the quantity on the right-hand side of Eq. (136) can be written as 



pU+D&t 



e -ei £ e e,A, | A(Z)d£. 

041) 

Let 

> JjAt 



pt+±l 



B( A/) = J A(i)dt. 

(142) 


I he physical meaning of 2?(A/) is that it represents the net acceleration which a Brownian particle 
may suffer on a given occasion during an interval of time A/. 

Equation (136) becomes 

u-Uoe~ 0, = e*<> A ‘-‘>#(A/), (143) 


and we require that as l—* the quantity on the right-hand side tends to the Maxwellian distribu¬ 
tion (140). We now assert that this requires the probability of occurrence of different values for l?(A/) be 
governed by the distribution function 


1 

w{B[ A/])=-exp (-|£(A/)|74gA/) (144) 

(4irgA/)* 

where 

q=0k T/m. (145) 


To prove this assertion we have to show that the distribution function W(u, t ; u 0 ) derived on the 
basis of Eqs. (143) and (144) does in fact tend to the Maxwellian distribution (140) as/—»». We shall 
presently show that this is the case but we may remark meantime on the formal similarity of Eq. (144) 
giving the probability distribution of the acceleration B(At) suffered by a Brownian particle in time 
A/ and Eq. (108) giving the probability distribution of the increment A/? in the position of a particle 
describing random flights in time A/. It will be recalled that for the validity of Eq. (108) it is neces- 
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sary that At be long enough for a large number of individual displacements to occur; analogously, 
our expression for U'(fl[A/]) is valid only for times At large compared to the average period of a 
single fluctuation of A(t). Now, the period of fluctuation of A(t) is clearly of the order of the time 
between successive collisions between the Brownian particle and the molecules of the surrounding 
fluid; in a liquid this is generally of the order of 10 21 sec. Accordingly, the similarity of our expres¬ 
sion for w(Z?[A/]) with Eq. (108) in the theory of random flights, leads us to interpret the accelera¬ 
tion B(At) suffered by a Brownian particle (in a time At large compared with the frequency of col¬ 
lisions with the surrounding molecules) as the result of superposition of the large number of random 
accelerations caused by collisions with the individual molecules. This is of course eminently reason¬ 
able; but the reason why q in Eq. (144) has to be precisely that given by Eq. (145) is due to our re¬ 
quirement that W(u,t;u 0 ) tend to the Maxwellian distribution (140) as t—+ oc. We shall return to 
these questions again in §5. 

We now proceed to prove our assertion concerning Eqs. (143), (144) and (145) : 

We first prove the following lemma: 

Lemma I. Let 


(146) 


Then, the probability distribution of R is given b\ 


W(R) =- 


r 


4 wq M)di 


- exp ( — [if |>/ 4 9 J^ **(*)<<{). 


(147) 


In order to prove this, we first divide the interval (0, I) into a large number of subintervals of 
duration A/. We can then write 




* = £ HjAt) f A(()d(. 
* 


(148) 


Remembering our definition of B(At) [Eq. (142)] we can express R in the form 


where ^ 

T i =i(jAl)B(At)=4,,B(Al). 

According to Eq. (144) the probability distribution of r, is governed by 


(149) 

(150) 


, T(r - )= ^ir. exp( - j|r ' |,/2V >- (iso 

where we have written 

lj 2 = Gq'f'fAt. (152) 

probrem r , i r t n he f 8 EqS - ( ? S1) ,. with Eqs ' (34) and < 57 > shows we have reduced our present 

Hence, [cf. Eqs wTindTfi^] Y ° f rand ° m fligHtS in Cha P ter § 4 («)• 

1 

W{R)= -—-exp {-3\R\*/2Tl?) 

But (2 tEV/3)‘ ' \ (153) 


But 


T.lj* = 6q T.i'l',*At = 6q £/ T*(jAt)At, 


( 154 ) 
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We therefore have 


W(R) = 


exp ( - | R |, 


(155) 


which proves the lemma. 

Returning to Eq. (136) we notice that we can express the right-hand side of this equation in the 


form 


if we define 


f (*)</* 


\K£)=e*«-‘>. 


(156) 


(157) 


We can therefore apply lemma I and with the foregoing definition of ^(£), Eq. (155) governs the 
probability distribution of 

(158) 


Since, now, 


u — u o e~ 0t . 


s: 




-r: 


i 


20 


(159) 


and remembering that according to Eq. (145) 


we have proved that 

W'fu, /; u 0 ) 


q/0 = kT/m 


-[ 


m 


2xkT(l —e-™*) 


]■ 


exp [ — m | u — Uoe-*‘ 1 2 /2k T( 1 - e -*») ]. 


( 160 ) 

(161) 


We verify that according to this equation 

lE(u, , exp(-m|u|*/2*r) (<-.«) (162) 

i.e., the Maxwellian distribution (140). This proves the assertion we made that with the statistical 
properties of B( A/) implied in Eqs. (144) and (145), Eq. (143) leads to a distribution W(u, t\ Uo) 
which tends to be Maxwellian independent of u 0 as t —*«. 

W e shall now show how w ith the assumptions already made concerning B(At) we can further derive 
the distribution of the displacement r of a Brownian particle at time t given that the particle is at To 
with a velocity u 0 at time / = 0: 

Since 


r-r 0 = f u{t)dt , 


(163) 

** 0 

we have according to Eq. (136) 

_ * f - t 



r-r 0 = / **<*-*+«-*J 

or 0 


(164) 

r—r 0 —p- l u 0 ( 1 — e-**) = 1 1 

^0 •'o 

(165) 


We can simplify the right-hand side of this equation by an integration by parts. We find 



To-0-'Uo(\-e-»')=-p-'e-»' I eP*A($)d$+0~ x I A(()d(. 


f 


■i: 


(166) 
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Again, we can reduce this equation to the form 

7 —To — &~ l Uo( 1 — e~* 1 ) = f Mi 

" 0 

by defining 




Thus lemma I can be applied and with the definition of ^(£) according to Eq. (168), Eq 
governs the probability distribution of 

r-ro-^UoO 

i e , of r at time t for given r 0 and u 0 . Since, 


(167) 


(168) 

(155) 


(169) 


f — f ( 1 - 

Jo p J, 




r-dt, 


(170) 


we have 


= — (2/3/ - 3 + 4e-*' - c -™ 1 ), 

2p 


urt. ]' 

>y|r, /, r 0 , tip) -< —-V exp — <- 1 n 7 n 

1 2**7 [2/3/-3 + 4*-* , -e- s * l ]j 2£7'[2d/-3 + 4e *-*-5*«] | 

l or intervals of time long compared to /T ‘ the foregoing expression simplifies considerably. For, 
r t l f Se C,rCUmstanccs we can *K nore the exponential and the constant terms as compared to 

2 .Further, aS * c sha11 presentl >' sh <> w . <! r — r 0 1is of order / [cf. Eq. (174)]; hence we can also 

neglect u 0 ( 1 -e *')& » compared to r-r 0 . Thus Eq. (171) reduces to 


(173) 


W(r ' r °* Uo) ~( 4 ” £)/ )| exp \r-r»\'‘/4Dt) (/»,3" 1 ) (172) 

where we have intrexluced the “diffusion coefficient” D defined by 

D — kT/mfi = kT/6irarj. (173) 

In Eq. (173) we have substituted for 0 according to Eq (133) 

x f ° r thC mea " SqUare diSP,aCCm ^ al ° ng any (»y. the 

<( x - x o) 2 )» = $ < I r - To | % = 2Dt = (k T/2nran)t. (174) 

Hus is Einstein s result. Equation (174) has been verified by Perrin to lead to consistent and satis- 
v and a. Va ^ ^ B ° ,tzmann constant k by observation of ((x-x 0 2 ))*,// over wide ranges of T, 

sftn ss 2 b >; 

5uch “ ns the nuJL 


N rx, 

s J., exp( - 


x*/4 Dt) 


(4 Dty 


The agreement is satisfactory. See Table II. 

we C cX?u^ 
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Iabli: II. Observations and calculations of the distribution of the displacements of a Brownian particle. 


Range 
i X 10 * cm 


1 st set 

Obs. Calc. 


2nd set 

Obs. Calc. 


0 - 3.4 
3.4- 6.8 
6 8 - 10.2 
10.2-17.0 


82 

66 

46 

27 


91 

70 

39 

23 


86 

65 

31 

23 


84 

63 

36 

21 


Obs. 

168 

131 

77 

50 


Total 


Calc. 

175 

132 

75 

44 


flights. And therefore, according to the ideas of / §5, describe the motion of Brownian particles also 
as one of diffusion and governed by the diffusion equation. We shall return to this connection with the 
diffusion equation from a more general point of view in §4. 

Returning to Rq. (171) we see that, quite generally, we have 


(175) 


/( .Uol 2 kT 

( 1 r - r 0 1 2 >a, =-( 1 - e~ s, )--}-3 -( 2 fit - 3 + 4er* - e-**'). 


F m3- 

Averaging this equation over all values of i/ n and remembering that (! Uol 2 )*» = 3kT/m we obtain 

kT 

«|r —r 0 | 2 »A, = 6-03/- 1+«-*)■ (175') 

m3 2 

I-or /—♦ =c , Rq. (175') is in agreement with our result (174), while for /—»0 we have instead 

kT 

«|r-r 0 | 2 »*. = 3—/ 2 =<|u 0 |%/ 2 . (175") 

m 

So far we have only inquired into the law of distributions of u and r separately. But we can also 
ask for the distribution IV (r, u, t \ u 0 , r 0 ) governing the probability of the simultaneous occurrence of 
the velocity u and the position r at time t, given that u = u 0 and r = r 0 at / = 0. The solution to this 
problem can be obtained from the following lemma: 


Lemma IR Let 


and 


-£■ 




(176) 




(177) 


Then, the bivariate probability distribution of R and S is given by 


W{R, S) = 


1 


where 


8t x'(FG-IT)' 


exp [ - (G | R | = - 2 IIR •S+F\S ( *)/2(FG - IT) ] 


(178) 


F=2qfr(S)dt; G-2q f H=2q f +(&*(&#. 

Jo Jq Jo 


(179) 


The lemma is proved by writing R and S in the forms [cf. Eqs. (149) and (150)] 

tUU)B(At ); S = E, <f>(jAt)B(At) 


(180) 


and remembering that the distribution of B is Gaussian according to Eq. (144). The problem then 
reduces to the one considered in Appendix II and the solution stated readily follows. 
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To obtain the distribution \V(r, u. t\ u l(l r„) we have onlv to set [cf. Kqs. (157), (158), (167) and 
(168)] 


/? = r-r o -d-‘u 0 (l - e ~*'); *(*)=/3-*(l 


S — u -u,z a ‘\ 


<*>(£) =^<1-0, 


and [cf. Kqs. (159) and (170)] 


and final! 


F = 50->(20/-3 + 4*-*'-* :a '); G = </d '(1 


r- 


// = 2q& x I H'«-“(l-c 3l f-‘ ) W/ = 7 d -(l 


(181) 


(182) 


(183) 


3. The Theory of the Brownian Motion of a Particle in a Field of Force. 

The Harmonically Bound Particle 

In the presence of an external field of force, the Langevin Kq. (132) is generalized to 

du dt= —pu + A(t) + K{ r, t) (184) 

\shere K(r, t ) is the acceleration produced by the field. In writing this equation we are making the 

same general assumptions as are involved in writing the original Langevin equation (cf. the remarks 
at the end of §1). 

In solving the stochastic equation (184) we attribute to A(t) or more particularly for 


B(At) 


-/ 


e-t-Ax 


*(«)</« 


(185) 


the statistical properties already assigned in the preceding section [Kq. (144)]. The method of 

solution is illustrated sufficiently by a one-dimensional harmonic oscillator describing Brownian 
motion. 1 he appropriate stochastic equation is 


du dt = — Hu + A (Z) - ur.r. 


(186) 


where « denotes the circular frequency of the oscillator. We can write Kq. (184) alternatively in the 

d' 1 x/dt' + tidx/dl + u-x = A (/). ( 187 ) 

What we seek from this equation are. of course, the probability distributions W(x. /; x 0 , u 0 ), Wiu f 

of Fn U a \ X °' Uo) ' J° ° htain thcSe distributions wc first write down the formal’solution 

Dq. (187) regarded as an ordinary differential equation. The method of solution most appropriate 

Ea 0 fT87 P 1 , ’ CSent PUrP °T ,S °' thC variatio " the Parameters. In this method, as apphed to 
Kq. (187), we express the solution in terms of that of the homogeneous equation: PP 


where M i and are the roots of 


i.e., 


x = a, exp (miO+Ui exp ( M s0 
m 2 + / 3 a.+w 2 = 0 ; 


^i- itf+dP 2 — w 2 ) 1 ; M2= - i/9-(i/3 2 —w 2 )*. 


(188) 

(189) 

(190) 


° f f ° rm 088) Wh - e - - « ‘-ions of time 

exp (int)(dai/dt) 4-exp (ud){da 2 /dt) = 0. 


( 191 ) 
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From Eq. (187) we derive the further relation 


mi exp (mt) (dai/di)+nt exp M(dat/di)=A(l). 
Solving Kqs. (191) and (192) we readily obtain the integrals 

1 r‘ 

Mi-d -I exp (-mt)A(t)dt+aio, 

Ml —M2 

“ 2 = - f exp (-M*$M($)d$+a 20t 

Ml - M2 

where a, 0 and <i 20 are constants. Accordingly, we have the solution 
* = ( ex P (mi/) f exp ( —Mi£M(£M£-exp (m 2 /) f exp ( — ms£)j4 (£)</£ 

Ml - M2l */ 0 */ n 


( 192 ) 


(193) 


+a 10 exp (mi /)+020 exp (M 2 /). (194) 

F'rom the foregoing equation we obtain for the velocity u the formula 

w = -1 mi exp (^it) f exp ( — m,£M ({)</£ —a »2 exp CmsO f exp (- Ma ()A(()d( 

Ml M 2 I •'0 


+M 1 O 10 exp (mi/)+M 2O 20 exp (M 2 /). (195) 

The constants aio and a ao can now be determined from the conditions that x = x 0 and u = u 0 at / = 0 
We find 


Thus, we have the solutions 



X oM 2 Uq 


Ml —M2 



*0Ml — Mo 
1- 


Ml —M2 


(196) 


and 


1 pt 

x H - [(X 0 M 2 -W 0 ) exp ( mi/)-(xomi — «o) exp ( m 2 /)]= I A(t)Mt)dl t 

Ml “M2 J 0 

1 r l 

-[mi(* 0 M 2 —Mo) exp (Mi/)-M*(*oMi-tto) exp (m* 0u = / A(t)t(t)dt, 

Ml —M2 J n 


(197) 


(198) 


where we have written 


1 

*(*)=-[exp [Mi(/-i)]-exp Cm2(/-{)]], 

Ml—M2 

1 

<*>(*)= -[mi exp [mi(/-£)]-m 2 exp [m 2 (/-£)]]. 

Ml—M2 


(199) 

- 


It is now seen that the quantities on the right-hand sides of Eqs. (197) and (198) are of the forms 
considered in lemmas I and 11 in §2. Accordingly, we can at once write down the distribution functions 
W(x t t; Xo, Mo), W(u, /; xo, Mo) and lV(x, u, /; xo, u 0 ) in terms of the integrals 

and f t(t)4>(S)dt. (200) 

•'o 


f Vd)d {; J <t>’(t)d( 
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With \p{£) and <£(£) defined as in Eqs. ( 100 ) we readily verify that 


f wm=— 1 —\—~ 

J o (mi~M:H2mi M'J 


(m? exp (2 mi/) +P 1 exp (2ji 3 i)) ~ 


Ml + M2 


(1|TM2 

(exp [(/ii+/i 3 )/] — 11 —- , (201) 


2MlM2 


f <t>-(t)d$ = - f .J( Ml exp (2 mi0 + M 2 exp (2^-.-/)) 

•'o (mi — M;) 2 L 


2miM2 
Mi +-Mi 


1 Xp ['.Mid" Mil)*] — 1) ~ ilMid-M.-) , (202) 


and 


r 


tU)# 1 ()d£ = -(exp (mi/)— exp w)) 2 . 

2(mi —M2) 2 


(203) 


At this point it is convenient to introduce in the foregoing expressions the values of and H 2 ex¬ 
plicitly according to Eq. (190): We find that the quantities on the left-hand sides of Eqs. (197) and 
(198) become, respectively, 


and 


x 0 .d-f-2// 0 

x-XoC tf ‘ /2 cosh ’>dd- e * 1 .sinh Id,/, 

di 

2.r„u; 2 d-dMo 

u - u&-* ,n cosh JdiH- 1 ? *" 2 sinh }di/, 

01 


(204) 


(205) 


where we have introduced the quantity di defined In 


Similarly, we find 


di = (d 2 -4ard. 


I >A 2 (£)d£ ——-(2d 2 sinh 7 £di/+d#i sinh di/ + di 2 ), 

•^0 2oo*d 2u, 7 di 2 d 

r‘ 1 

I <tr(Z)dt = - --(2d 2 sinh 7 $£,/-£/3, sinh d,/-bdi 2 ). 

*'0 2d 2drd 

J *(*)<*>(*)</* = 2drV- <,< sinh 2 Id,/. 


and 


(206) 


(207) 


(208) 


( 200 ) 


It is seen that all the foregoing expressions remain finite and real even when di is zero or imaginary 

Ihus while all the expressions remain valid as they stand in the "overdamped” case (d, real) the 

formulae appropriate for the periodic (d, imaginary) and the aperiodic (d, zero) cases can be readils 
written down by replacing 


respectively, by 


cosh idi/. d, 1 sinh Jd,/ and dr 1 sinh dd, 


1 . 1 

cos a )\t, -sineU,/ and-sin 2u»,/ where « 1 = (a> 2 — \/p)\ 


( 210 ) 


2 w 1 


2co, 


( 211 ) 


in the periodic case, and by 

1.5* and / r?19 v 

in the aperiodic case. 1 ’ 

As we have already remarked, we can immediately write down the distribution f. irW - f , 
quantities on the left-hand sides of the Eqs. (,97) and (,98) [i e the quanU^ Z ’and uVsH 
according to lemmas I and II of §2 in terms of the integrals (207)-(209). Thus, ^ 
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H'U, t , x o, Uo) = 


771 


I 


J 




exp — 


0 


i 0 1 2u 0 \* 

* 0 e *'• : | cosh \P\t-\-— sinh J- e~M s inh \Q x t) 


2k T I /2P 8 x 

‘—7 1 ~ e 0, l — sinh 2 J/Si/H— sinh fat+l J 

{ \0i 2 fa ) 


We have similar expressions for W{u, /; x 0 . u 0 ) and IT(*, u, /; x 0 , 

I'he quantities of greatest interest are the moments <*>*. <*>*, <*%. < M % and <*«)*. We find 

( 0 \ 2 w 

cosh $/3,H— sinh */3,/sinh $/3,/, 

/ 8\ 


(213) 


0i 

/ \ / 0 \ 2xou 2 

{u)^ = Uoe- fim l cosh \fat -sinh \fat \ - e ~*' n sinh \fat, 

' 0i '0i 


kT 

(x*)* = (x)S+ - { 1 


< w 2 >* = ( m )*, 2 + 


mu> 2 { 

kT 

771 


/ P 

2— si 

V 0x 2 


1 


p 0 \ 1 

sinh 2 J0 iH -sinh /3,/+1 ) L 

* 0x / J 

-€-*•(2 — sinh 2 \0xl-— sinh 1 ^ 1, 

' 0\~ 0i / I 


^ (214) 


4 0k T 

(xu)*= (*)*<k>*-1- e->‘ sinh 2 1/3,/. 

0i 2 m 

* 

The foregoing expressions are the average values of the various quantities at time t for assigned values 
of x and u (namely. x 0 and u 0 ) at time / = 0. We see that 


<x)a,-»0; (m)*—>0; 0, 

* T/mu , 2 ; (« 2 )a, = kT/m, 


t—+ X . 


(215) 


By averaging the various moments over all values of u 0 and remembering that 

(«o)a» = 0; (u 0 2 )^ = kT/m. 

we obtain from Rqs. (214) that 

((x))a, = x 0 e ~* tl2 ^cosh \8 lt +~ sinh h0i^. 

2xoa> 2 

«*»*=-« /s " 2 sinh \8\t, 


(216) 


0i 

kT 

«**»* = + 


-'Ycosh $0,/+— sinh $0,/) , 

\ mu 2 / V 0i / 




« 


mar \ mu 

4« / 


4a> / ft/ \ 

« 2 »a, =-1-1 x 0 2 - )e~ 0t sinh 2 \8 x t, 

77i 8i 2 \ m« 2 / 


(217) 


2w 2 / kT \ / p x 

((xw)) A , = I-*v \e~ fft sinh \& x t\ cosh $/3,H sinh \& x t J. 

01 V 771U) 2 / V /3j / 

Equations (214) and (217) show how the equipartition values (215) are reached as /—►» 
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4. The Fokker-Planck Equation. The Generalization of Liouville’s Theorem 

As we have already remarked on several occasions, in an analysis of the Brownian movement we 
regard as impracticable a detailed description of the motions of the individual particles. Instead, we 
emphasize the essential stochastic nature ot the phenomenon and seek a description in terms of the 
probability distributions of position and or velocity at a later time starting froin given initial distribu¬ 
tions. I hus, in our discussion ol the Brownian movement of a free particle in §2 we obtain explicitly 
the distribution functions H < u, t ; Uo), If t r, t ; u„, r u ) and If r , u , t ; Tn. u„) for given initial values of to 
and u 0 ; similarly, in $3 we determined the distributions W\u, /; .v. Jt «„), If’i.v, /; x 0 , u a ) and W(x, u, /; 
•to. u o) fora harmonically bound particle describing Brownian motion In deriving these distributions 
m §§2 and 3 we started with the Langevin equation [Eq i!32) in the field-free case, and Eq. (184) 
when an external field is present] and solved it in a manner appropriate to the problem. We shall now 
consider the question whether we cannot reduce the determination of these distribution functions to 
appropriate boundary value problems of suitably chosen partial differential equations. We have in 
mind a redui lion similar to that achieved in ( hapter I, §5 u here we showed how, under certain circum¬ 
stances. the solution to the problem of random flights can be obtained as solutions of boundary-value 
problems long familiar in the theory of diffusion or conduction of heat. I hat a similar reduction should 
Ik possible under our present circumstances is apparent when we recall that the interpretation of the 
problem of random flights as one in diffusion (or heat conduction) is possible only if there exist time 
intervals A/ long enough tor the particle to suffer a large number of individual displacements but 
still short enough for the net mean square displacement ■ ' Mt - to be small and of 0(M). And, it is 
m the essence of Brownian motion that there exist time intervals A/ during which the phvsical 
parameters (like position and velocity of the Brownian particle) change by '•infinitesimal” amounts 
while there occur a very large number of fluctuations characteristic of the motion and arising from 
the collisions with the molecules of the surrounding fluid. 

It is clear that for the solutions of the most general problem we shall require the density function 
lv (r, u /); in other words, we should really consider the problem in the six-dimensional phase space. 
Accordingly, we may state our principal objective by the remark that what we are seeking is es¬ 
sentially a generalization of Liouvilles theorem of classical dynamics to include Brownian motion 
But before we proceed to establish such a general theorem it will be instructive to consider the 
simplest problem of the Brownian motion of a free particle in the velocity space and obtain a differ¬ 
ential equation for IP(u. /); this leads us to the discussion of the Fokker-Planck equation in its most 
familiar form. 

(i) The Fokker-Planck Equation in Velocity Space to Describe the Brownian Motion of a Free Particle 

Let M denote an interval of time long compared to the periods of fluctuations of the acceleration 

f W °J curnn S >n the Langevin equation but short compared to intervals during which the velocity 
Ol a Brownian particle changes by appreciable amounts. Under these circumstances we should 
expect to derive the distribution function W(u. t+SI) governing the probability of occurrence of u 

t ‘ V" diSlribU,i ° n W(U ' ° 3t ,ime ‘ a '’ d “ k "° w1 ^ »f ‘he 'transition pZahiluy 

1 . Au) that u suffers an increment Au in time A*. More particularly, we expect the relation 


W(u 


f 


( 218 ) 


^(u] + l«) and C W(u lWo e h th ? iCa " y remark Z eXpeCtir * this intc S ral Ration between 
particle will take depends o„f ,1 ™ aC ' Ua " y SUPP ° sinK ' hat the ” which a Brownian 
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sta e of the system at Ume t is said to be a Markoff process. We may describe a Markoff process 
picturesquely by the statement that it represents “the gradual unfolding of a transition probability” 

in ““ tly ‘ he f am f ° f<; nsc as the development of a conservative dynamical system can be described 
as the gradual unfolding of a contact transformation.” That we should be able to idealize Brownian 
motion as a Markoff process appears very reasonable. But we should be careful not to conclude too 
hastily that every stochastic process is necessarily of the Markoff type. For, it can happen that the 
future course of a system is conditioned by its past history: i.e., what happens at a given instant of 
time / may depend on what has already happened during all time preceding /. 

Returning to Eq. (218), for the case under discussion we have 


1 


(219) 


( 220 ) 


t(u;Au)= — -— exp (“ I &U+&UAI | */ 4qAt) (q=0kT/m). 

(47rqAt) 1 

bor, according to the Langevin equation £ef. Eq. (142)") 

Au= -$uAt+ B(At) 

where B(At) denotes the net acceleration arising from fluctuations which a Brownian particle suffers 

in time A/; and. since the distribution of B(At) is given by Eq. (144). the transition probability (218) 
follows at once. 

Expanding W(u, t+At), Wlu-Au. ,) and *(u-Au; Au) in Eq. (218) in the form of Taylor series, 
we obtain 

dlV 

W(U, /) +-A/ + 0(A/ 2 ) 

dt 


„+» -+» 


r ™| div 1 d 2 w d-w 

J J \ mu, t)-Z—Au i+ - E ~Au> + Z —Au,A Ui + 

—*30 ^ — 30 ** — 0C 


» du. 


2 * dUi 2 


•'<; du x dli j 


d+ 1 dhL 

X { +(u ; Au) — 52 Am, 3— 51-Am, 2 + 52 -Am,Am/+ 

l * dUi 2 » du, 2 i<j dUidUi 


d(Au l )d{Au i )d{Au i ) (221) 


or, writing 


(Am,)*, — J' A«,^(u; Au)d(Au), 
(A u*)b = j* Aufyfu; Au)d(Au), 


— 30 


,+« 


we have 


(Am,Am,)*, — j* AuiAUj}f/(u ; Au)(/(Au), 


dt 


dW dW 1 d-W d 2 W d 

At+0(Al 2 ) — — 52 — (Am j)*,d - — 51 — -(Am, 2 )*,-!-52-(Am,Am,)*,—52 W -(Am,)*, 

* du t l * du * «/ du.duj i dUi 

_ d d\v dW d ia 2 

+ 2 : (Am, 2 )*,-+ 52-<Am,Am/)a,+— 52-(A u*)*W 


i dUi 


du, if* i du, dUj 


2 < du:- 


a 2 


) ( 222 ) 


t-52 W- - (AM,AM>)*, + C>((AM,AM>AMt)*.). (223) 

»<> du,du, 


* 


3 


STOCHASTIC PROBLEMS IN PHYSICS AND ASTRONO M Y 


where the remainder term involves the averages of the quantities 

Au*, Au?Au, and Au ,Au jAn*, (i, j, k= 1, 2. 3). 

Kquation (223) can be written more conveniently as 

9W a id* 

—A/ + 0(A/»)* -£ -(lP<A« i ) h ) + - T - 

dt * Su t 2 i Hu? 

a 2 

+ L-(H 7 Au,Au i )*) + 0((Au,AUjAu k )*,), 

•</ du,du, 

which is the Fokkcr-PUinck equation in its most general form. 

For the transition probability (21 ^). 

(Am,)*, = -0u,At\ (Am ,Au ,)*, = 0(A/ 2 ); * Au , 2 >*, = 2qAt + Oi At-). 

Hence, Eq. (224) reduces in our case to 

dW 

—-A/ + 0(A/ 2 ) = |a tlivu (H'u)-f ^Yu-'H 7 ! AZ + OlA/-), 

at 

and passing now to the limit A/ = 0 we have 


(224) 


(225) 


(226) 


d\V/dl — 0 divu ( Wu) -\-qVu 2 W. (227) 

mpn^| ha 'l' C° W Sh f ° W u th L at i t | hofiistrit)ution function mu. I ; „„) obtained in §2, Eq. (161) is the funda- 

ntal solution of the hokker-Planck Eq. (227) in the sense that this is the solution which tends to 
tne o function 


S(Ui — Ml. o)S(u 2 — Ux o)6(u 3 — Uy o) 


(228) 


differ^ 0 ', T | Pr ° Ve thiS ',T fi I St " 0,C thaI but for thc ' Luplacian term. Eq. (227) is a linear partial 

Eq 227 will b °r- , Z' “T'?’ U ‘ S natUral t0 ”P ect that ,h <- S-neral solution of 

q. (227) will be intimately connected with that of the associated first-order equation 

(dW/dt) — a divu (Wu) =0. (229) 

subsidiarylyTtem 0 " ^ Cqua,ion involves thc three first in ^rals of the Lagrangian 


The required first integrals are therefore 


du/dl= —pu. 


(230) 


Accordingly, for solving Eq. (227) 

ue 0t = u o = constant. 

we introduce a new vector p defined by 

(231) 

Equation (227) now becomes 

9 = (£. v, $)=ue* t . 

(232) 

dW/dt = SpW+qe 201 ?^ IV. 

T his equation can be further simplified by introducing the variable 

(233) 

We have 

x =We~ 

(234) 


d X /d z x d 2 x d*x\ 

dt Vae 2 dr ) 2 dtp) 


(235) 
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The solution of this equation can be readily written clown by using the following lemma: 

Lemma I. If <t>(t) is an arbitrary function of time , the solution of the partial differential equation 

dx/dt = <t> 2 (t)V 9 - x (236) 

which has a source at p = p 0 at time t = 0 is 



We shall omit the proof of this lemma as it is very elementary. 

Applying this lemma to Eq. (235) we have the fundamental solution 



ue° l — u 0 2 




or, returning to the variable W according to Eq. (234) we have 


1 

W{u, t;u 0 ) = - 

0^(1-*-«>')/W 


exp {_ —&\u — u Q e~ 01 2 /2q{\ —e~‘ 6, )~] 


which agrees with our earlier result in §2, Eq. (161). 


(237) 


(238) 


(239) 


(it) The Generalization of Liouville's Theorem to Include Brownian Motion 

We shall now consider the general problem of a particle describing Brownian motion and under the 
influence of an external field of force. 

Let At again denote an interval of time which is long compared to the periods of fluctuations of the 
acceleration A(t) occurring in the Langevin Eq. (184) but short compared to the intervals in which 
any of the physical parameters change appreciably. Then, the increments Ar and A u in position and 
velocity which the particle suffers during A/ are 

Ar = t/A/; An = - (0u - K)At+ B(At), (240) 

where K denotes the acceleration per unit mass caused by the external field of force and B( A/) the 
net acceleration arising from fluctuations which the particle suffers in time A/. The distribution of 
B(At) is again given by Eq. (144). 

Assuming as before that the Brownian movement can be idealized as a Markoff process the prob¬ 
ability distribution I V(r, u, t-\-At) in phase space at time t-]-At can be derived from the distribution 
lV(r, u, t ) at the earlier time t by means of the integral equation 


W(r, u, /+ At) = 



— Ar, u-Au, /)^(r —Ar, u-Au\ Ar, Au)d(Ar)d(Au). 


(241) 


According to the Eqs. (240) we can write 

'{'(r, u\ Ar, Au)=yp(r, u\ Au)5(Ax — uiAt)8(Ay — uiAt)8(Az — u t At), (242) 

where the 6’s denote Dirac’s S functions and \J/(r, u;Au) the transition probability in the velocity 
space. With this form for the transition probability in the phase space the integration over Ar in 
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Eq. (241) is immediately performed and we get 


W{t, u, / + At) = J 


W(r — uAl, u -Au, t)t(r-uAt, u — Au, Au)d(Au). 


(243) 


Alternative!v, we can write 


W'(r + uA/, u, / + Al) = J W(r, u-Au, At)<f(r, u-Au: Au)d(Au) 


(244 j 


Expanding the various functions in the foregoing equation in the form of Taylor series and proceeding 
as in our derivation of the Fokker-Planck equation, we obtain [cf. Eq. (221)] 

/dW \ d Id-' 

I —+ti.gradr TV)A/ + 0(A**)«-E — {W(Au x >*,) + - E-(IF<Aw,%) 

v dl / < du, 2 . du? 


d- 


+ E-(ft / (AM 1 Auy)*,)-EO( (AUtAUjAUk)^). (245) 

«; du,du > 

This is the complete analog in the phase space of the Fokker-Planck equation in the velocity space. 
I-or the case (240), the transition probability Au) is given by [cf. Eq. (144)] 


+(u\Au) = 


exp (- !Au + (/3u - K)AI | */4qA(). 


(4irqAt)* 

And with this expression for the transition probability we clearly have 

< A *'•>*.= -(0Ui-Ki)At-, (Au?)^ = 2qAl + 0{At-): (Au l Au l )* = 0(At i ) 
Accordingly Eq. (245) simplifies to 


(246) 


(247) 


\dw I fa d 2 w 

I— 4-u-gradr W >A/ + 0(A/*) = < E -[(0«. - K t ) W] + q E- 

dl J l < du, i du* 


At + 0(At 2 ) t 


(248) 


and now passing to the limit At — 0 and after some minor rearranging of the terms we finally obtain 

awya/ + u«gradr W+K*gradu W=0d\ v« {Wu)+qVJW. (249) 

1 he foregoing equation represents the complete generalization of the Fokker-Planck Eq (227) to 

the phase space. At the same time Eq. (249) represents also the generalization of Liouville’s theorem 

?• C ^ a dynamics to include Brownian motion; more particularly, on the right-hand side of 

q I C , C have thc terms ansin f> front Brownian motion while on the left-hand side we have the 
usual Stokes operator D/Dl acting on W. 

(m) The Solution of Equation (249) for the Field Free Case 
When no external field is present Eq. (249) becomes 

dW/dt + u •gradr W= 3/3 IT-f 0u -gradu W+qVJW. ( 250 ) 

To solve this equation we again note that the equation 

dWfdl + u»gradr W= 30IT+ flu «gradu \V (251) 
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* six independent integrals of the Lagrangian subsidiary system 

du/dl=—0u; dr/dt = u. 

Two vector integrals of this system are 

ue dt = /i; t + u/0=I 2 . 

Accordingly, to solve Eq. (119) we introduce the new variables 

o=U. V, !) = ue*'\ P = (X, Y, Z) = r+u/0. 
lor this transformation of the variables we have 

0 W 0 

=— W(q, P, /)+/3p«gradp W, 


(252) 


(253) 


(254) 


01 dl 

gradr W =grad/* IV, 

gradu W=e 0t gradp W+{ 1//3) grad/* W, 

Vu 2 W = e 2 *‘V p 2 W+ ( 2/0)e*‘V 9 -Vp W+{\ /&) Vp 2 W. 
Substituting the foregoing equations in Eq. (250) we obtain 

d W/dt = 3/3 W + ? 1 <r 2 *‘V p 2 1T+ (2/0)e 9t V 9 *Vp 1T+ (1 //J 2 ) Vp 2 IT} 


> (255) 


and finallv 


(256) 


Again, we introduce the variable 


x = We~™ 


Equation (257) reduces to 


d x /dt = q ! Vx + (2//3)e»‘V p *V PX + (1/0-)Vx I. 


(257) 


(258) 


(259) 


or, written out explicitly 


Ox 

01 


/0 2 x 

= q\ e * ( — 

\<3£ 2 


a 2 x o- x a 2 x\ 2 / a 2 x d 2 x 

+ — + — )+-«"(-+- 


o 2 x \ l /0-x o-x «5 2 x\ 1 


—I-IH—(-H-h 

0? Or) 1 d?/ 0 \d£dX d v dY d{dZ/ 0 3 \dX* 0 Y 7 dZ 1 




(260) 


To solve this equation we first prove the following lemma: 


Lemma II. Lei <p(t ) and \J/(t) be Kuo arbitrary functions of time. The solution of the differential equation 


Ox 0*x 0-x 0-x 

— = </>*(0 - h 2 < t >( l )+( l ) -+ **(/)- 

0t 0? d&X dX* 


(261) 


which has a source at £ = X = 0 at t = 0 is 


1 


X = 


2ttA» 


exp [- (a?+2h£X + bX*)/2±^\ 


(262) 


where 


-jT 


V-{t)df, h = 


—r 


4>(t)t(l)dt 


; b = 2 ^ <t> 2 


( t)dt . 


and 


A = ab — h-. 


To prove this lemma we substitute for x according to Eq. (262) in the differential Eq 
After some minor reductions we find that we are left with 


(263) 

(264) 
(261). 
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1 d& da i dhi db\ 

-+ $*-b2{AT— + X 9 — 4- 2*= (o re 2 + 2a x h x £X 4- A . S -V-- a,) 

A dt dl dt dt 

+44"Hoxh l ? + h x b l X' + tX[h l *+a l b x ]-h l ) + 2t‘(hdi:- + 2h x b x ZX + bdX i -b l ) = 0, (265) 


where we have written 

a x = a h\ — h'\\ 6 t = 6/A. 

Equating the coefficients of $X and X- in (265) we obtain the set of equations 

da x /dt = - 2(a,$+/»,^)'*\ 

db x /dt = — 2(h x <p -\-b x \p)-, 

dh x /dt = — 2(a x <t>-\-h x \J/)(h x <t>-\-b x \p), 
and 


(266) 


(267) 


d\/dl — 2^{a x <t>- 4- 2h x d>\p 4- b i^- 2 ). (268) 

It is readily verified that Eq. (268) is consistent with the Eq. (267) [see Eqs. (271) and (272) below]. 
Since [cf. Eqs. (266)] 

da 'dt = Mdai/dt) +a x (d± /dt), (269) 

we have according to Eqs. (267) and (268) 


da dt — — 2A(fli0 + /j,^) 2 4- 2A[a x 2 (fi 7 -\-2a x h]<t>\f/-\-a x b x \f/-) = 2Ma x b x — h 2 )^-, 


or 


Similarly we prove that 
Hence, 


da/dt = 2\y-. 

db dt = 2 <tr\ dhfdl = — 2<t>\l. 


f 


Vdl\ h 


f 


<t>\pdt 


/ 


<t> 2 dl. 


(270) 

(271) 

(272) 


(273) 


The lemma now follows as an immediate consequence of the boundary conditions at / = 0 stated. 

In order to apply the foregoing lemma to Eq. (260) we first notice that the equation is separable in 
t e pairs of variables (£, X), (»?, Y) and (f, Z). Expressing therefore the solution in the form 

x= xiU, X)xt(v. E)x»(f. Z), (274) 

we see that each of the functions xi, X 2 and X 3 satisfies an equation of the form (261) with 

<t>(t) = q'c*‘\ \f/(l) = ql/ 0 . ( 275 ) 

Hence, the solution of Eq. (260) with the boundary condition 

P = po, P=P 0 at / = 0 (276) 

1 

-exp { — [a | p — go | *4- 2A(p — p 0 ) *(P — Po) 4-61 P — P 0 \ 2 ]/2A J (277) 


is 


X = 


where 


8*-»A« 


1 


1 


h= - 2qp~ l f e*‘dl=- 

•'o 


2q0-*(e"-t), 


(278) 
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and 


g-g 0 = e 9, u -u 0 ; P ~ P 0 = r-\-u/(3 — r 0 — u o /0. 

In Eq. (2/9) To and Uo denote the position and velocity of the Brownian particle at time/ 


3Bt 


XV= 


8tt 3 A* 


:>xp ! - [a p-o 0 2 -f2/;(p-po) >(P - P 0 )+b\ P - P n \-]/2A\. 


(279) 

0. Finally, 

(280) 


We shall now verify that the foregoing solution for XV obtained as the fundamental solution of 
Fq. (250) agrees with what we obtained in §2 through a discussion of the Langevin equation: With R 
and Sas defined in Eqs. (181) we have 


Accordingly, 


o-po = e 9l S; P — Po = R+(\/0)S. 


(281) 


a|p-p„' 2 + 2^(p-p 0 ).(/>-/> 0 ) + 6|/>-/> 0 |2 = a€^|Si 2 d-2^(/?.S-f-(l/^)|S; j )-F6|/?-4-(l//3)S| 2 ,) 

= e- 9t (F\S\ 2 — 2HR»S + G\ /?| 2 ), 

F = a + 2h&-'e-* , + bQ-’ l e- ,i9 '\ G = be~ 29 ‘; II = - (he~ 91 + b0-'e-'-°'). 


where 


(282) 


(283) 


With a, b and h as given by Eqs. (278) we find that 


Further, 


F=q0-*(20l-3 + 4e-‘ ll -e-v i ); G = q0~'( 1 -*-*»»); II = q0~\ 1 -*-*)* 

FG - II- = (ab - h*)e-- 9 ‘ = Ac- 2 -*'. 


(284) 

(285) 


Thus the solution (280) can be expressed alternatively in the form 


XV = 


1 


8x 3 (FG -IP)* 


exp [ — (FI S| 2 — 2IIR-S + G] R\-)/2(FG — IP)] 


(286) 


C omparing Eqs. (284) and (286) with Eqs. (178), (182) and (183) we see that the verification is 
complete. 


(ie) The Solution of liquation (249) for the Case of a Harmonically Bound Particle 

The method of solution is sufficiently illustrated by considering the case of a one-dimensional 
oscillator describing Brownian motion. Equation (249) then reduces to 

dXV dXV dXV dXV d-XV 

- + u - urx - = 0u -+ 01 V+q -. (287) 

dt dx du du du 3 


As in our discussion in the two preceding sections we introduce as variables two first integrals of the 
associated subsidiary system: 

dx/dt = u ; du/dt= — 0u — uPx. (288) 

Two independent first integrals of Eqs. (288) are readily seen to be 

(xmi — u) exp (— mj/) and - u) exp (— ud) ( 289 ) 

where mi and mj have the same meanings as in §3 [cf. Eqs. (189) and (190)]. Accordingly we set 

£ = (xfn — u) exp (— ms/); r) = (xn 2 —u) exp ( —mt). (290) 

In these variables Eq (287) becomes 
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a w / (T-w anr d*W\ 

- = 0W+ql exp (- 2nd) - \-2 exp ( — (mi + mj)*) -Fexp [-2ml) -). 

dt V d? 3£3t7 dr? / 


(291) 


Introducing the further transformation 
we finally obtain 


ir=x^\ 


(292) 


dx / &X &X \ 

= <71 exp (-2^?/) -(-2 exp [- (mi Em?)/ J -K*xp ( -2 M iO— ). 

a/ V dir dtdv drr / 


(293) 


This equation is of the same form as Eq. 1 261) in lemma 11 Hence the solution of this equation which 
tends to 6(£ — £o)5(»j — no) as /—*0 is 


where 


Further, 


1 

x =-exp ! — [a(£ — £o) : +2/t({- ?o)(n — no) + ft(n — no)-]/2A|, 

2?rA‘ 

r' <7 

a = 2^ I exp {-2mt)dl = — [1 -exp ( - 2 mi0]. 

•'o Mi 

r' q 

b = 2q I exp ( — 2nit)dt = — [1 —exp (— 2 m?/)], 

«/ 0 m? 

r' 2q 

h= -2q I exp [ - (mi + miJO*/ =--[1 -exp [-(mi + mi)/]J . 

*^0 Mi4-M? 


(294) 


> (- ? 95) 


£ 0 = *oMi — M 0 ; no = XoM2— Wo. (296) 

where x 0 and m 0 denote the position and velocity of the particle at time / = <>. It is again verilied that 
the solution 


W — - - exp i — [a(£ —£o) 2 + 2/l(£ —£ 0 )(t?— rjn)+6(r) — no) 2 ]/2 a I, 

2?rA’ 


(297) 


obtained as the fundamental solution of Eq. (287) is in agreement with the distributions obtained in 
§3 through a discussion of the Langevin equation. 

(v) The General Case 

Our discussion in the two preceding sections suggests that in dealing with Eq. (249) quite generally 
ue may introduce as new variables six independent first integrals of the equations of motion 


ndependent hrst integ 
dr/dl = u ; du/dl = — 0u + K. 


(298) 


These are the Lagrangian subsidiary equations of the linear first-order equation derived from (249) 
after ignoring the Laplacian term qVJW. If /,, • • •, / 6 are six such integrals, we introduce 


7i(r, u, /), • • •, / 6 (r, u , /) 

as the new independent variables. If we further set 

W= x e' 0, t 


(299) 


(300) 


Eq. (249) will transform to 

d X /dt = q[yu- x ~\i x . ... ( 301 ) 

where the Laplacian of x on the right-hand side has to be expressed in terms of the new variables 
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\\c shall thus be left with a general linear partial differential equation of the second order for y; 
and we seek a solution of this equation of the form 


1 

- 

8t 3 A* 


(302) 


where Q stands for a general homogeneous quadratic form in the six variables /,, • • •, / 6 with coeffi¬ 
cients which are functions of time only. Further, in Eq. (302) A is the determinant’of the matrix 

formed by the coefficients of the quadratic form. In this manner we can expect to solve the general 
problem. 


{in) The Differential Equation for the Displacement (t»0~ l ). The Smoluchowski Equation 

We have seen that all the physically significant questions concerning the motion of a free Brownian 
particle can be answered by solving Eq. (250) with appropriate boundary conditions. However, if 
we are interested only in time intervals very large compared to the '‘time of relaxation" 0~' we can 
apply the method of the Fokker-PIanck equation to configuration space (r) independently of the 
velocity space. For, according to Eq. (172), we may say that for a free Brownian particle, the transi¬ 
tion probability that r suffers an increment Ar in time A/»0-' is given by 


where 


1 

\KAr) --exp (— | Ar| 2 /AD At), 

(4t/)A/)* 


(303) 


D = q/0 2 = kT/m0. 


(304) 


Thus, again with the understanding that A t»0~' we can write [cf. Eq. (218) and the remarks follow¬ 
ing it] 



* + A*) = 


U'(r —Ar, t)^(Ar)d(Ar). 


(305) 


Applying now to this equation the procedure that was followed in the derivation of the Fokker- 
PIanck equation in the velocity space we readily obtain the “diffusion equation” 

dw/dt = DV r i w. (306) 

That we should be led to the diffusion equation is not surprising since Eq. (303) implies that for time 
intervals At»0~ l the motion of the particle reduces to the elementary case of the problem of random 
flights (Chapter I, §4 case [c]) and the analysis of / §5 leading to Eq. (112) applies. 

Equation (306) is valid for a free Brownian particle. I o extend this result for the case when an 
external field is acting we start from Eq. (249) which is quite generally true in phase space. We first 
rewrite this equation in the form 


dW / 1 \ / q K q \ 

-= 01 divu— divr 1( Wu+- gradu W - W -\— grad r W I -fdivr 

dt \ 0 / \ 0 0 0 2 / 


/Q K \ 

( —gradr IV - W ) . 

V0-- 0 / 


We now integrate this equation along the straight line 

r + u/0 = constan t = r 0 , 

from u = — oo to -f- ». We obtain 


(307) 


(308) 


d 

dt 


x 


Wdu 


+ ‘-r. 


-X 


+u d *-r. 


/? K \ 

divrl — gradr IV - W \du. 

V0 2 0 J 


(309) 
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\\ c shall now suppose that K{r) does not change appreciably over distances of the order of (q/0 1 )*. 
Then, starting from an arbitrary initial distribution H r (r. u, 0) at time / — 0 we should expect that a 
Maxwellian distribution of the velocities will be established at all points after time intervals A/»/3" *. 
( onsequently, if we are not interested in time intervals of the order of 0 1 we can write 


HAr. u. I 


( 

\2nk'J / 


exp i — m u - 2kT)uir, tt. 


(310) 


With these' assumptions Kq. (309) becomes 


diu I q Kr o) 

divn gradro w(r 0 ) ~ :e(r o) 

M F 0 


( 311 ) 


I he passage from Kqs. (309) to (311) is the result of our supposition that in the domain of u from 
which the dominant contribution to the integral on the riglu-hand side of Kq. (309) arises (namely, 
i u:^(kT/m)l=(q £)*) the variation of r (which is of the order u a — iq d 3 )‘) is small compared 
to the distances in the configuration space in which K and w change-appreciable I he required general¬ 
ization of Icq. (306) is therefore 


die 

- =di\r 

dl 


( q K \ 

I gradr w — w ) 

V & J / 


(312) 


Kquation (312) is sometimes called Smoluchowski's equation. 

An immediate consequence of Kq. (312) may be noted. According to this equation a stationary 
diffusion current j obeys the law 


j — 0 1 Kw ~ 2 grad w = constan t 

If K can be derived from a potential 53 so that 


(313) 


Kq. (313) can be rewritten in the form 


K = — grad 53 


(314) 


J - q0'- exp ( - 0fS/q) grad (w exp (053/ q)), (315) 

where it may be noted qff = kT m. Integrating Kq. (315) between any two points A and B we obtain 


J * I 0 exp ((353 /q)ds =- w exp (053/ q) 

j a m 


kr 


A 


H 


(316) 


an important equation, first derived by Kramers. 

Wo may finally again draw attention to the fact that Eqs. (.106) and (312) are valid only if we ignore 
when A h aPPCn ln r Pme mtervals of thc order of ^ 1 and space intervals of the order of („%>) I • 
^ phase C sp e ace CtS "* WC Sh ° U ' H B ° baCk *° FqS (249) ° r (250) which rigorously valid 


(vti) General Remarks 


rat -r- ,i - 1 ?— tesr.SE; 

boundary conditions which the solutions will have to r , , P ^ cd ,n the form of 

.onndary vaine prohiem in P ar^^^ 
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tlic necessary solutions. I he alternative analysis based on the Langevin equation would in general 
be too involved. 

Further examples of the use of the partial differential equations obtained in this section will be 
found in Chapters III and IV. 


5. General Remarks 

A general characteristic of the' stochastic processes of the type considered in the preceding sections 
is that the increment in the velocity, Au which a particle suffers in a time A/ long compared to the 
periods of the elementary fluctuations can be expressed as the sum of two distinct terms: a term 
KAt which represents the action of the external field of force, and a term 8u(At) which denotes a 
fluctuating quantity with a definite law of distribution. Thus 


Au= ATA/ + 5u(A/); (317) 

the corresponding increment in the position, Ar is given by 

Ar = uA/, (318) 

where u is the instantaneous velocity of the particle. 

When dealing with stochastic processes of the strictly Brownian motion type we further suppose 
that the term 8u(At) in Eq. (317) can in turn be decomposed into two parts: a part -puAt represent¬ 
ing the deceleration caused by the dynamical friction -flu and a fluctuating part B(At) which is 
really the vector sum of a very large number of very "minute" accelerations arising from collisions 
with individual molecules of the surrounding fluid: 


6u(A/)= -0uAt+B(At). (319) 

It is this particular decomposition of 8u(At) that is peculiarly characteristic of stochastic processes 
of the Brownian type. 

Concerning B(At) in Eq. (319) we have supposed in §§2, 3, and 4 that it is governed by the distri¬ 
bution function [cf. Eqs. (144) and (145)3 


1 

w(£[A/])=-exp (— B(At) I i /4qAl), (320) 

(4t?A/)» 

where 

q = 0kT/m. (321) 

In this choice of the distribution function for B(Al) we were guided by two considerations: First, 
that starting from any arbitrarily assigned distribution of the velocities we shall always be led to the 
Maxwellian distribution as /—(or, alternatively that the Maxwellian distribution of the velocities 
is invariant to stochastic processes of the type considered); and second that during a time A/ in which 
the position and the velocity of the particle will change by an “infinitesimal" amount of order At the 
particle will in reality suffer an exceedingly large number of individual accelerations by collisions with 
the molecules of the surrounding fluid. This second consideration would suggest, from analogy with 
the simple case of the problem of random flights [Eq. (108)], a formula of the form (320). The 
particular value of q (321) then follows from the first requirement. 

Combining Eqs. (319) and (320) we obtain for the transition probability 5u ) for u to suffer 
an increment 8u due to the Brownian forces only, the expression 

1 

Su) = -exp (- \/3uAt + 5u | */4qAl). (322) 

(4 irgA/) 1 

We shall now briefly re-examine the problem of continuous stochastic processes more generally 
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from the point of view of the invariance of the Maxwell-Boltzmann distribution 

H'= constant exp i—[m j u 2 + 2m$$(r)] 2kT\; K—— grad 5? 


(323) 


to processes governed by F.qs. (317) and (318) only i.e., without making the further assumptions 
included in Eqs. (319) (322). 

Assuming, as we have done hitherto, that the stochastic process we are considering is of the Markoff 
type we can write the integral equation [cf. Eq. (241)] 


IV (r 


,u,t + At) = JJ \Vir-Ar,u — Au,t)^(r-Ar,u-Au\Ar, Au)d(Ar)d(Au). 


(324) 


According to Eqs. (318) we expect that [cf. Eq. <242)] 

'Kr. u; At, Au) = 4(r, u, Au)6(Ax~UiAt)8(Ay-u t Al)6\As—u 3 At) 


(325) 


Equation (324) becomes 


W(r 


f 


(32 6 ) 


whore we have further substituted for Au according to Kq. (317). Equation (326) can be written 
alternatively as 


/ 


(327) 


Applying to this equation the same procedure as was adopted in the derivation of the Fokker- 
Planck and the generalized Liouville equations in §4, we readily find that [cf. Eq. (245)] 

| ^ ^ ) d 1 <f 

—+ u.gradr W+K 'gradu W\Al + 0(AP) « - E —(W<6uM+- E-( 8 «,-*)*,) 

1 1 ‘ du, 2 . du? 

d 2 

+ H- 7 —(li ,r (6Mi6M J )A t )+0((iM,fitt l iw 4 )«.) (328) 

»<> du x du, 

where <«!<.>* etc., denote the various moments of the transition probability *(r, u, bu). 

We shall now suppose that 

(5 «.)*. = m .A/H-0(A/ 1 ); <6« l 2 >*. = /z ll A/ + 0(A/ 2 ); (6uMj)a, = u,jAt + 0(AP), (329) 


ami that all averages of quantities like buM.biu are of order higher than one in At. With this under¬ 
standing we shall obtain from Eq. (328), on passing to the limit A( = 0 the result 

dW d 1 d 2 S- 

-- + u.grad, lE+K-grad. W= - E --( W Hi ) +- E — W.,) + E- (W^). (330) 

' OU, 2 i 0U * i<J du,du y 

We now require that the Maxwell-Boltzmann distribution (323) satisfy Eq (330) identieallv 
andt*^ Sf ^ diStribUti ° n 10 Kq ‘ (330) - ^ ^ left-hand side of this equali^^h^s 


E —[exp ( 

■ du, 


»«IuIV2*Dm.-]+- E ——[exp ( 

2 . du 2 


m|u |*/2 *r) Mll ] 

d 2 


+ E 


•<» dUidiij 


[exp (-m|u' 2 /2*7> iy ] = 0. (331) 
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Equation (331) is to regarded as the general condition on the moments. 
For the distribution (,322) 


u,= —0u t ; un=2q = 2f}kT/m; 



(332) 


Also, the third and higher moments of 8u do not contain terms linear in At. 

We readily verify that with the M ’s given by (332) we satisfy Eq. (331). It is not, however, to be 
expected that (332) represents the most general solution for the m’s which will satisfy Eq. (331). 
It would clearly be a matter of considerable interest to investigate Eq. (331) (or the generalization 
ot this equation to include terms involving m jk etc.,) with a view to establishing the nature of the 
restrictions on the m's implied by Flq. (331). Such an investigation might lead to the discovery of new 
classes of Markoff processes which will leave the Maxwell-Boltzmann distribution invariant but 


which will not be of the classical Brownian motion type. It is not proposed to undertake this investiga¬ 
tion in this article. We may, however, draw special attention to the fact that according to Eqs. (331) 
and (332), 0 can very well depend on the spatial coordinates (though q/0[ = kT/tn~\ must be a con¬ 
stant throughout the system). Thus, the generalized Liouville Eq. (249) and the Smoluchowski 
Eq. (312) are valid as they stand, also when /3 = £(r). 


CHAPTER HI 

PROBABILITY AFTER-EFFECTS: COLLOID STATIS¬ 
TICS; THE SECOND LAW OF THERMODY¬ 
NAMICS. THE THEORY OF COAGULATION, 
SEDIMENTATION, AND THE ESCAPE OVER 
POTENTIAL BARRIERS 

In this chapter we shall consider certain prob¬ 
lems in the theory of Brownian motion which 
require the more explicit introduction than we 
had occasion hitherto, of the notion of probability 
after-effects. The fundamental ideas underlying 
this notion have already been described in the 
introductory section where we have also seen 
that colloid statistics (or, more generally, the 
phenomenon of density fluctuations in a medium 
of constant average density) provides a very 
direct illustration of the problem. The theory of 
this phenomenon which has been developed 
along very general lines by Smoluchowski has 
found beautiful confirmation in the experiments 
of Svedberg, Westgren, and others. This theory 
of Smoluchowski in addition to providing a 
striking application of the principles of Brownian 
motion has also important applications to the 
elucidation of the statistical nature of the second 
law of thermodynamics. In view, therefore, of 
the fundamental character of Smoluchowski’s 
theory we shall give a somewhat detailed ac¬ 
count of it in this chapter (§§1-3). (In the later 
sections of this chapter we consider further 
miscellaneous applications of the theory of 
Brownian motion which have bearings on prob¬ 
lems considered in Chapter IV.) 


1. The General Theory of Density Fluctuations 
for Intermittent Observations. The Mean 
Life and the Average Time of Recurrence of a 
State of Fluctuation* 

Consider a geometrically well-defined small 
element of volume v in a solution containing 
Brownian particles under conditions of diffusion 
equilibrium. (More generally, we may also 
consider v as an element in a very much larger 
volume containing a large number of particles 
in equilibrium.) Suppose now that we observe 
the number of particles contained in v system¬ 
atically at constant intervals of time r apart. 
Then the frequency IV(n) with which different 
numbers of particles will be observed in v will 
follow the Pot's-son distribution (see Appendix III), 

W(n) = e~'v*/n!, (333) 

where v denotes the average number of particles 
that will be contained in v: 

(w)*t = J2n W(n) = e~’v £-= v. (334) 

n—0 n—1 (Tl — 1) ! 

In other words, the number of particles that will 
be observed in v is subject to fluctuations and the 
different states of fluctuations (which, in this 
case, can be labelled by n) occur with definite 
frequencies. 


According to Eq. (333) the mean square 
deviation S 2 from the average value v is given by 

6 * = <(« - „)% = <«*)* - (335) 

FVofessor M. S. Bartlett has pointed out (Nature 165, 727, 1950) that the treatment of the average time of re- 
currence in this section is not free of errors. 
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or, since 




<n%= £ »*■ 


t w v 


n-0 


* \f n * y n 1 

= e~’v vY -b L - 

*-3 (n — 2)! «-i (« — 1)! 

= y 2 4- 


(336) 


we have 


5* = v 


(337) 


It is seen that the frequency with which the 
different states of fluctuation n occur is inde¬ 
pendent of all physical parameters describing 
the particle (e.g., radius and density) and the 
surrounding fluid (e.g., viscosity). The situation 
is, however, completely changed when we con¬ 
sider the speed with which the different states 
of fluctuations follow each other in time. More 
specifically, consider the number of particles rt 
and m contained in v at an interval of time r 
apart. We expect that the number m observed 
on the second occasion will be correlated with the 
number n observed on the first occasion. This 
correlation should be such, that as /—*0 the 
result of the second observation can be predicted 
with certainty as n, while as /—►» we shall ob¬ 
serve on the second occasion numbers which will 
increasingly be distributed according to the 
Poisson distribution (333). For finite intervals 
of time r w'e can therefore ask for the transition 
probability W(n\m) that m particles will be 
counted in v after a time r from the instant when 
there was observed to be n particles in it. 

In solving the problem stated toward the end 
of the preceding paragraph we shall make, follow¬ 
ing Smoluchowski, the two assumptions: (1) 
that the motions of the individual particles are 
not mutually influenced and are independent of 
each other and (2) that all positions in the ele¬ 
ment of volume considered have equal a priori 
probability. Under these circumstances we can 
expect to define a probability P that a particle 
somewhere inside v will have emerged from it 
during the lime r. The exact value of this prob¬ 
ability after-effect factor P will depend on the 
precise circumstances of the problem including 
the geometry of the volume v. In §2 we shall 
obtain the explicit formula for P when the 


motions of the individual particles are governed 
by the laws of Brownian motion [Eq. (380)]]; 
and similarly in §3 we shall obtain the formula 
for P for the case when the particles describe 
linear trajectories [Fq. (413)]]. Meantime, we 
shall continue the discussion of the speed of 
fluctuations on the assumption that the factor P 
as defined can be unambiguously evaluated 
depending, however, on circumstances. 

It is clear that the required transition prob¬ 
ability can be written down in an 

entirely elementary way if we know the prob¬ 
abilities with which particles enter and leave the 
element of volume. More precisely, let A, (n> 
denote the probability that starting from an 
initial situation in which there are n particles 
inside v some i particles will have emerged from 
it during r; this probability of emergence of a 
certain number of particles will clearly depend 
on the initial number of particles inside v. 
Similarly, let F. t denote the probability that i 
particles will have entered the element of volume 
t> during r. Since one of our principal assumptions 
is that the motions of the particles are not 
mutually influenced, the probability of entrance 
of a certain number of particles cannot depend on 
the number already contained in it. We shall 
now obtain explicit expressions for these tw r o 
probabilities in terms of P. 

The expression for A, (n) can be written down 
at once when we recall that this must be equal 
to the product of the probability P' that some 
particular group of i particles leaves v during r, 
the probability (1 — P) n ~ i that the remaining 
(n—i) particles do not leave v during r, and the 
number of distinct ways C, n of selecting i par¬ 
ticles from the initial group of n. Accordingly, 

n ! 

A t (n> = C/LP'O -P) n ~i = - p>(\-p\n-i 

*!(» — *)! (338) 


which is a Bernoulli distribution. 

To obtain the expression for Ei we first 
remark that this must equal the probability 
that i particles emerge from the element of 
volume v on an arbitrary occasion; since, under 
equilibrium conditions the a priori probabilities 
for the entrance and emergence of particles 
must be equal. Remembering further, that £, is 
independent of the number of particles initially 
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contained in v, we clearly have 

E, = (A, (n >)* = £ JV(n)Ai<*>, (339) 

n—i 

where W(n) is the probability that v initially 
contained n particles; W{n) accordingly is given 

by ( 333 )- C ombining Eqs. (333), (338), and 
(339) we therefore have 


E,= 


x e " v n 
£ — 


n\ 








e~’(vP)' « 

- £ ---— 


/! 


n « » 


{n-i)\ 


e-{vP) 


e 


»(!-/•) 


Thus, 


i! 


> (340) 


E x = e~' p (vP)'/i\, 


( 3 41) 


in other words, a Poisson distribution with 
variance vP. 

Using the formulae (338) and (341) for A t < n > 
and E x we can at once write down the expression 
for the transition-probability W(n\n+k) that 
there is an increase in the number of particles 
from n to n-\-k. We clearly have 

W(n\n + k)**'£,Ai<»'E i + k . (342) 

t —0 

Similarly, for the transition probability 
W(n;n — k) that there is a decrease in the 
number of particles from n to n — k we have 

W(n\n-k) = ii A (k^n). (343) 

i —J: 

From Eqs. (338), (341), (342), and (343) we 
therefore obtain 


= (0 (346) 

and 

wt{y)=e-' p (vP)v/y\ (0<Cy< oc). (347) 

*ci ( (x) is the probability that some x particles 
remain in v after a time r when initially there 
were n particles in it; similarly, w 2 (y) is the 
probability that v particles enter v in time r. 
In terms of the distributions (346) and (347) we 
can rewrite Eqs. (344) and (345) as 

n 

W(n;n+k) = Z ™i ln) (n-i)w 2 (i+k), (348) 

l—O 

and 

n 

W(n;n-k) = '£w l <*>(n-i)wt(i-k), (349) 

i—A- 

or, writing m for n+k, respectively n — k, we 
see that both Eqs. (348) and (349) can be in¬ 
cluded in the single formula 

W(n,m)= £ «/i<->(*)w,(y). (350) 

x+y— m 

In other words, the distribution W(n, m) for a 
fixed value of n is the “sum” of the two distribu¬ 
tions (346) and (347). And, therefore, the mean 
and the mean square deviation for the distribu¬ 
tion of m according to (350) is the sum of the 
means and the mean square deviations of the 
component distributions (346) and (347) (sec 
Appendix IV). Since [cf. Eqs. (334) and (335) 
and Appendix I Eqs. (621) and (624)] 

<x) A . = n(l-P); ((x-(x)»PU = nP(l-P), (351) 
and 

< y)»=rP ; <(y-<y)*)%-r/>. (352) 

we conclude that 


W{n \ n-f-k)=e~' p £ CfP^l -/>)—• 

i—O 

and X(vP)<+*/(i-+-k)\, (344) 

W(n\ n-k)=e~' p £ C, n P'(\- P) n ~ i 

l —it 

xivpy-'/a-k)'. ( 345 ) 

The foregoing expressions for the transition 
probabilities are due to Smoluchowski. 

The formulae (344) and (345) in spite of their 
apparent complexity have in reality very simple 
structures. To see this we first introduce the 
Bernoulli and the Poisson distributions 


(m )*, = «( 1 —P) + vP, 

and 

<(m - <>»)*)% = nP(l - P) + vP. 
Let 


A n = m — n. 

Then, according to Eqs. (354) and (355) 


(353) 

(354) 

(355) 


(A„)», = (w)„- n = {v — n)P, 

and 

(A = <(m - (w)*, + (m )*, - w) 2 )*, 

= ((m — (m)*,) 2 )*,-f- ((m)*, —n) 2 

= nP(\— P) + vP+(v — n yp *, 
or 

(A n 2 )*, = P s [ (v — n)- — n ] -f- (n + v) P. 


(356) 


(357) 

(358) 
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It is seen that according to Eq. (356) the 
number of particles inside r changes, on the 
average, in the direction of making n approach 
its mean value, namely v. In other words, the 

densitv fluctuations studied lure in terms of a 

* 

“microscopic' analysis of the stochastic motions 
of the individual particles are in complete agree¬ 
ment with the macroscopic theory of diffusion. 

The quantities A n *, and 'A,.-)*, represent the 
mean and the mean square of the* differences 
that are to be expected in the numbers observed 
on two occasions at ail interval of time r apart 
when on the first occasion n particles were ob¬ 
served. If now, we further average A,.*, and 
(A* 2 )*, over all values of n with the weight func¬ 
tion Win) we shall obtain the mean and the 
mean square of the differences in the numbers of 
particles observed on consecutive occasions in a 
long sequence of observations made .it constant 
intervals r apart. Thus [cf. Eq. (334)] 


(A)*,= ((A (v— w)*,P = 0, (359) 


(A 5 )*, = ((« - m) 1 )*, = - 2(n) A ,(»i) A , 

= 2(r + v)-2i? = 2v, (P=l). (363) 

W e shall now show how we can define the 
mean life and the average time of recurrence for a 
given stati of fluctuation in terms of the transi¬ 
tion probability W(n ; n\ : 

W(n; n) = e ' f ‘ V C"Pm1 - P)« <>P) , /i!. (364) 

x-0 

which gives the probability that n will be ob¬ 
served on two eonsreutive occasions. Accord¬ 
ingly, the probability <t> n (kr) that the same num¬ 
ber n will be observed on ik— 1) consecutive 
occasions (at constant intervals r apart) and 
that on the kth occasion some number different 
from ti will be observed is given by 

•Pn(kT) = W k •( n ; «)[1 — lV(n ; «)]. (365) 

On the other hand, in terms of o-.lkr) we can 
give a natural definition to the mean life to the 
state of fluctuation n b\ the equation 


a result which is to be expected. On the other 
hand [cf. Eq. (337)] 

(A 2 )*. = ((An 2 )*,)*. | 

= 7”[( [v-n ) 2 )», -(«)*.] +(m + v)^P (360) 

= P 2 (5-— (w)*,) + ((«)*,+ i»)P, ) 

or 

(A 2 )*, = 2 vP. (361) 

Equation (361) suggests a direct method for 
the experimental determination of the prob¬ 

ability after-effect factor P from the simple 
evaluation of the mean square differences 
(A 2 ;*, from long sequences of observations of n 
(see §2 below). Further, according to Eq. (361) 

(A 2 )*,= 2»' when P=l. (362) 

I his result.is in agreement with what we should 
expect, since, when P=1 there will be no corre¬ 
lation between the numbers that will be ob¬ 
served on two occasions at an interval r apart; 
(A 2 )*, then simply becomes the mean square of the 
differences between two numbers each of which 
(without correlation) is governed by the same 
Poisson distribution; and, therefore [cf. Eqs. 

(333) and (336)], 


7 „ = £ kT<p,,(kr). (366) 

i-i 

Combining Eqs (365) and (366) we obtain 

7„= r[ 1 — Win ; n)] £ kW' K '(«;»/). (367) 

i-i 

The infinite series in Eq. (367) is readily evaluated 
and we find 

7„ = ---—. (368) 

1 -W{rr,n) 

In an analogous manner we can define the 
time of recurrence of the state n by the equation 

-r. 

®’. = Y,kr\p n (kT), (369) 

i-i 

where i PJkr) denotes the probability that 
starting from an arbitrary stale which is not n 
we shall observe on k—\ successive occasions 
states which are not n and on the kth occasion 
observe the state n. If 

W(Nn ; Nn) (370) 

denotes the probability that from an arbitrary 
state we shall have a transition to a state 
which is also ^n, then clearly 

tnikr) = W k ~ x fNn ; ,Vn)[l - W{Nn ; Nn)~\. (371) 
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Substituting the foregoing expression for ^ n (kr) 
m Eq. (369) we obtain [cf. Eqs. (365) and (368)] 


1 -W(Nn;Nn) ' 

W e shall now obtain a formula for W{Nn ; Nn) 
Eirst of all it is clear that 

1 - W(Nn ; .Vw) = W{Nn ; «), (373) 

where H'(A r « ; n) is the probability that from an 
arbitrary state ^n we shall have a transition 
to the state n. Now, under equilibrium condi¬ 
tions, the number of transitions from states y*n 
to the state n must equal the number of transi- 

sitions from the state n to states. ^ n; accord¬ 
ingly 

[1 - W(n)]lV(Nn ; n) 

= lV(n)tl-W(n;ti)l (374) 
where W{n) is given by Eq. (333). Hence. 



Fig. 3. 



W(Nn ; n) = W{n) 


1 — W(n\ n) 


1 - W{n) 


(375 


Combining Eqs. (372), (373), and (375) w 
obtain 



_r 1 - W(n) 

1 -W(n;n) W{n) 


(376) 


Finally, we may note that between T n and (-)„ 
we have the relation 



* ~ Win) 
W{n) 


(377) 


In the next section we shall give a brief ac¬ 
count of the experiments of Svedberg and West- 
gren on colloid statistics which have provided 
complete confirmation of Smoluchowski’s theory 
of density fluctuations which we have developed 
in this section. Also, the formulae for T n and 0„ 
which we have derived have important applica¬ 
tions to the elucidation of the second law of 
thermodynamics to which we shall return in §4. 


2. Experimental Verification of Smoluchowski’s 

Theory: Colloid Statistics 


made by means of an ultramicroscope on the 
numbers of particles in a well-defined element of 
volume in a colloidal solution. These observa¬ 
tions, made systematically at constant intervals 
7 a P ar t, are secured either by the use of inter¬ 
mittent illumination (Svedberg) or by counting 
on the ticks of a metronome (Westgren). The 
volumes in which the counts are made are de¬ 
fined either optically by illuminating only plane 
parallel layers several microns in thickness 
(Svedberg) or mechanically by having the solu¬ 
tion under observation sealed between the ob¬ 
jective of the microscope and a glass plate and 
observing with the help of a cardioid condenser 
(Westgren). The dimensions of the element of 
volume at right angles to the line of sight arc 
defined directly by limiting the field of observa¬ 
tion (see Figs. 3 and 4). 

The colloidal particles describe Brownian 
motion and since the intervals of time we are 
normally interested in are never less than a few 
hundredths of a second we can suppose that the 
motions of the particles are governed by the 
diffusion equation [cf. Eqs. (133), (304), and 
(306)] 


In the experiments of Svedberg, Westgren, 
and others on colloid statistics observations are 


; hu/dt — DVHv; 

D = q/(J 2 = kT/m(j = kT/6xarj. 


(378) 
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For, according to our discussion in Chapter II, 
§§2 and 4 the validity of the diffusion equation 
requires that we only ignore what happens m 
time intervals of order & 1 anil for colloidal gold 
particles of radius a = 50mm this time of relaxa¬ 
tion is of the order of 10 9 -10~ l ° second. 

From Eq. (378) we conclude that the prob¬ 
ability of occurrence of a particle at r 2 at time / 
when it was at r, at time / = 0 is given by [cf. 
Eq. (172)] 

1 

-exp ( — r« —ri 2 4 Dt). (379) 

(4 wDty 

On this basis we can readily write down a general 
formula for the probability after-effect factor P 
introduced in §1. For, by definition, P denotes 
the probability that a particle somewhere inside 
the given element of volume v (with uniform 
probability) at time / = () will find itself outside 
of it at time /= r. Accordingly 

p = -f fexp (— !ri — r 2 ’V4/}r)i/iy/r 2 , 

(4ttDt)*vJ J (380) 

where the integration over ri is extended over all 
points in the interior of v while that over r 2 is 
extended over all points exterior to v. Alter¬ 
natively, we can also write 

— 1 — f f 

{4irDr)h< J rt „ J,„ v 

Xexp (- |r,-r 3 j 2 /4Z>r)tfri</r 2 , (381) 

where, now, the integrations over both r, and r 2 
are extended over all points inside v (indicated 
by the symbols and r 2 te). 

We thus see that for any geometrically well- 
defined element of volume in a colloidal solution 
we can always evaluate, in principle, the prob¬ 
ability after-effect factor P in terms of the 
physical parameters of the problem, namely, the 
geometry of the volume v, the radius a of the 
colloidal particles, and the coefficient of viscosity 
V of the surrounding liquid. On the other hand, 
this factor P can also be determined empirically 
from a direct evaluation of the mean square of 
the differences in the numbers of particles ob¬ 
server! on consecutive occasions in a long se¬ 
quence of observations made at constant in¬ 


tervals r apart and using the formula [Eq. (361)] 

<A-% = 2»/>, (382) 

where v is the average of all the numbers ob¬ 
served. A comparison of the predictions of the 
theory with the data of colloid statistics there¬ 
fore becomes possible. Once P has been de¬ 
termined [either theoretically according to 
Eq. (381) or empirically from Eq. (382)] we 
can predict the frequency of occurrence, //(«, m), 
of the pair ( n, >n) in the observed sequence of 
numbers. For, clearly; 

//' n, m) = H'(w) Witt ; m), (383) 

where ll'i n I is the frequence of occurrence of n 
according to Eq. 1 333) and Win ; w) is the transi¬ 
tion probability from the state n to the state nt 
according to Smolut howski’s formulae (344) and 
1 345). Again a comparison between the predic¬ 
tions of the theory with the results of observa¬ 
tions becomes possible. 

Comparisons of the kind indicated in the 
preceding paragraph were first made’ by Smolu- 
chowski himself who used for this purpose the 
data provided by Svedberg’s experiments. How¬ 
ever. later experiments bv Westgren carried out 
with the expressed intention of verifying Smolu- 
chowski's theory provide a more stringent com¬ 
parison between the predictions of the theory 
and the results of observations. We shall there¬ 
fore limit ourselves to describing the results of 
Westgren's experiments only. 

Westgren conducted two scries of experiments 
with the arrangements shown in Figs. 3 and 4. 
In the first of the two arrangements (Fig. 3) 
the particles under observation are confined to 
a long rectangular parallelepiped (see the shaded 
portions in Fig. 3). Under the conditions of this 
arrangement it is clear that the variation in the 
number of particles observed is predominantly 
due to diffusion at right angles to the lengthwise 
edge. Consequently, the formula for P appro¬ 
priate to this arrangement is [cf. Eq. (381)] 

\~p- 1 c k r K 

h(AirD T yJ Q J 0 

X exp [ - (x 1 - r 2 ) 2 / 4DT~]dx\dx2, (384) 
where h denotes the width of the element of 
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volume under observation (see Fig. 3). Intro¬ 
ducing 2(7)7-)* as the unit of length, Eq. (384) 
becomes 


1 


~ P = —J f exp [-(*,- 

air' J 0 •'o 


hyytxdl 2l (385) 


where we have written 


a = h/2(D T )K (386) 

We readily verify that Eq. (385) is equivalent to 

>--P= 2 ~ exp (-,*), (387) 

«7r> J 0 

or, after an integration by parts we find 


2 

7 J = I" , I exp(-{*) 

TT‘ 


<11 


1 

H- [\ - exp (-a 2 )]. 

Ot 7T 


(388) 


I-or the second of W'estgrcn's arrangements 


(Fig. 4) the element under observation is a 
cylindrical volume and the variations in the 
numbers observed are in this case due to the 
diffusion of particles in all directions at right 
angles to the line of sight. Accordingly we have 



Xexp (-£ 1 2-£ 2 2 + 2£,£ 2 cos t ))dd, (389) 

where 

oc = r o/2(Dt) *, (390) 

r o denoting the radius of the cylindrical element 
under observation. The integrals in (389) can 
be evaluated in terms of Bessel functions with 
imaginary arguments and we find 

/ 5 = r 2 ''“[/ o( 2 v / a) + 7 l( 2v'a)]. (391) fi 


Westgren has made several series of counts 
with both of his experimental arrangements. 
We give below a sample extract from one of his 
sequences: 


21 1 1 1 10221 1 123230000001 1001011 1223345 
3 4221213 2 0 221022212 3 2223222222133422 


The foregoing counts were obtained with the 
first of the two experimental arrangements de¬ 
scribed with the following values for the various 
physical parameters: 

h = 6 . 56 m : 7) = 3.95X10-*; 

r= 1.39 sec.; a = 49.5 /im; (393) 

7'= 290.0°K ; y= 1.428. 

First of all, it is of interest to sec how well the 
Poisson distribution (333) represents the ob¬ 
served frequencies of occurrence of the different 
values of n. 1 able III shows this comparison for 
the sequence of which (392) is an extract. It is 
seen that the representation is satisfactory. Also, 
the observed mean square deviation for this 
sequence is 1.35 while the value theoretically 
predicted is v which is 1.43; again the agreement 
is satisfactory. 

Turning next to questions relating to prob¬ 
ability after-effects we may first note that each 
of the observed sequences can be used for several 
comparisons. For, by suitably selecting from a 
given sequence of sufficient length we can derive 


others with intervals between consecutive ob¬ 
servations which are integral multiples of that 
characterizing the original sequence. Thus, by 
considering only the alternate numbers we ob¬ 
tain a new sequence in which the interval r 
between two observations is twice that in the 
original sequence. 

As we have already remarked, for any given 
sequence, we can compute theoretical values of 
P in terms of the physical parameters of the 
problem according to Eq. (388) or (391) depend¬ 
ing on the experimental arrangement used. For 
the same sequences, we can also, using Eq. (382), 
derive values of P from the observed counts 


Table III. The Poisson distribution for 
W'(n). y= 1.428. 


n = 

0 

1 

2 

3 

4 

5 

6 

7 


381 

568 

357 

175 

67 

28 

5 

2 


380 

542 

384 

184 

66 

19 

5 

2 


4 The functions e '/m(x) are tabulated in Watson's 
Bessel functions (Cambridge, 1922), pp. 698-713. 
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Fig. 5 


from the respective values of the mean square 
differences In Tables IV and V we have 

made, following Westgren, the comparison 
between the values P derived in this manner for 
two typical cases. The agreement is satisfactory. 
I he confirmation of the theory is shown in a 
particularly striking manner in Figs. 5 and 6 
where a comparison is made between the ob¬ 
served and the theoretical values of P in its 
dependence on t for different values of h (or r 0 ). 

It is now seen that an analysis of the data of 
colloid statistics actually provides us with a 
means of determining the Avogadro’s constant 
.V. I-or, front the mean square difference (A 2 )*, 
and the mean value of n (namely v) we can de¬ 
termine P. On the other hand, according to 
F.qs. (380) and (381) P is determined by the 


1 able IV. Comparison of the probability after-effect 
factor P derived Irom Eq. (388) and the experimental 
arrangement of Fig. 3 (Westgren). h = 6.56m; n = 49.5 mm; 
T= 290.0°K; D-3.95X10"*; *= 1.428. 





<*> A v 


^0bM 


^*calc 

1.39 



1.068 


0.374 


0.394 

2.78 



1.452 


0.513 


0.517 

4.17 



1.699 


0.600 


0.587 

5.56 



1.859 


0.656 


0.634 

9.73 



2.125 


0.744 


0.713 

13.90 



2.265 


0.793 


0.760 

Table 

V. 

Comparison 

of 

the probability 

after-effect 

•actor P 

der 

ivetl 

from E 

In. 

(391) and 

the experimental 

arrangement 

of rifc. 4 (Westgren). r 0 = 

10.0 M ; 

• 

a = 63.5/iji! 


"K; 


3.024X1 

!0-» 

; v= 1.933. 



r(**C.) 



<**>Av 


^obs 


^ealc 

1.50 



0.836 


0.217 


0.238 

3.00 



1.200 


0.310 


0.332 

4.50 



1.512 


0.391 


0.401 

6.00 



1.718 


0.444 


0.456 

7.50 

i- 

— — 

1.939 


0.502 


0.503 



Fig. 6 


geometry of the volume v only , if the unit of 
length is chosen to be 2 {Dt)K Hence, from the 
empirically determined value of P we can deduce 
a value for this unit of length. Iri other words, a 
determination of tlie diffusion coefficient D is 
possible. But [cf. Eq. (378)1 

D — kl 6rarj = (R 'N){T/tirari), (394) 

where R is the'gas constant and A’ the Avo- 
gadro's number. Thus A' can be determined. 
With the second of his two arrangements West¬ 
gren has used this method to determine N. 
As a mean of 50 determinations he finds N = 6.09 
X 10 23 with a probable error of 5 percent; this 
is in very satisfactory agreement with other 
independent determinations. 

T urning next to the frequency of occurrence 
//(n, m) of the pair of numbers \tt, m) in a given 
sequence, we can predict this quantity according 
to Eq. (383); these predicted values can again 
be compared with those deduced directly from 
the counts. Such a comparison has also been 
made by Westgren whose results we give in 
Table VI. 

Finally, we shall consider the experimental 
basis for the formulae (368) and (376) for the 
mean life and the average time of recurrence of a 
state of fluctuation. Using the counts of Sved- 
berg, Smoluchowski has made a comparison 
between the values of T n and 0„ derived em¬ 
pirically from these counts and those predicted 
by Eqs. (368) and (376). The results of this 
comparison are show-n in Table VII. 

The long average times of recurrence for the 
states of large n are to be particularly noted 
(see §4 below). These long times are, however, 
a direct consequence of the "improbable” 
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Table VI. The observed and the theoretical frequencies 
of occurrence of the pairs (n, ni) in a given sequence 
(*=1.428; P = 0.374). [In each case the top figure gives 
the observed number while the bottom figure (italicized), 
the number to be expected on the basis of Fq. (383). j 


»: 

m « 0 

l 

2 

.3 

4 

5 

6 

o 

210 

126 

35 

1 

0 

i 



221 

119 

32 

6 

1 

i _ . 


1 

134 

281 

117 

29 

1 

i 


1 

119 

262 

122 

31 

5 

i 

. _ 

2 

27 

138 

108 

63 

16 

3 

— _ 


22 

122 

149 

63 

15 

.? 

— 

* 

10 

20 

76 

38 

24 

6 

0 

»» 

6 

31 

63 

56 

22 

5 

/ 

4 

2 

2 

14 

22 

13 

11 

3 


1 

5 

15 

22 

15 

6 

> 

L* 

s 

— 

0 

2 

10 

10 

\ 

3 

% 9 

- _ 

1 

3 

5 

6 

3 

/ 


nature of these states. For, according to Fq. (376) 

Hn x (T 'W(n)) = T(e*n\ v n ) (w»*). (395) 

which increases extremely rapidly for large 
values of n. For example, the number 7 was 
recorded only once in Svedberg’s entire sequence 
of 518 counts; but the average time of recurrence 
for this state is 1105r. Again, the number 17 
(for instance) was never observed by Sved berg; 
and this is also understandable in view of the 
average time of recurrence for this state which is 
0 , 7 - 10 13 . ! 

In concluding this discussion of the experi¬ 
mental verification of Smoluchowski’s theory, 
we may remark on the inner relationships that 
have been disclosed to exist between the phe¬ 
nomena of Brownian motion, diffusion, and 
fluctuations in molecular concentration. But 
what is perhaps of even greater significance is 
that we have here the first example of a case in 
which it has been possible to follow in all its 
details, both theoretically and experimentally, 
the transition between the macroscopically 
irreversible nature of diffusion and the micro¬ 
scopically reversible nature of molecular Auc¬ 
tions. (These matters are further touched upon in 
§§3 and 4 below.) 

3. Probability After-Effects for 
Continuous Observation 

The theory of density fluctuations as de¬ 
veloped in §1 is valid whenever the physical 
circumstances of the problem will permit us to 


introduce the probability after-effect factor P. 
It will be recalled that this factor P( T ) is defined 
as the probability that a particle, initially, 
somewhere inside a given element of volume will 
emerge from it before the elapse of a time r. 
And. as we have seen in §1, we can express all the 
significant facts related to the phenomenon of 
the speed of fluctuations in terms of this single 
factor P(r). But the theory as developed in §1 
applies only when r is finite, i.e., for the case 
of intermittent observations. We shall now show 
how this theory can be generalized to include 
the case of continuous observations. 

F irst of all, it is clear that we should expect 

P(t) —>0 as r—0. (396) 

Hence, according to Eq. (364), 

W(n;n) = e~' p {\ -P)» + 0(P 3 ) 

(t —>0; P—+0), (397) 

or 

W(n ; n) = 1 — (n + u)P(t) + 0(P S ) 

(r—»0; P —>0). (398) 

From this expression for W(n ; n) we can derive 
a formula for the probability 0„(/)A/ that the 
state n will continue to be under observation 
for a time t and that during / and t-\-At there will 
occur a transition to a state different from n. 
For this purpose, we divide the interval (0, /) 
into a very large number of subintervals of 
duration At. Then, from the definition of <t> n (t)Al 
it follows that 

4n(t)Al-ZW(n;»)y'**l 1 - W(n; *)], (399) 

or, using Eq. (398), 

<t>M)At = [1 - (» + v)P{At) + 0(P»)]"*' 

X(n + v)P(At). (400) 

This last equation suggests that to obtain con¬ 
sistent results it would be necessary that 

P(At) = 0(At) (At—*0). (401) 

On general physical grounds, we may expect that 
this would in fact be the case. But it should not 
be concluded that Eq. (401) will be valid for any 
arbitrary idealization of the physical problem. 

F'or example, it is not true that P(At) is O(At) for 
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the case of Brownian motions idealized as a 
problem in pure diffusion as we have done in §2. 
For, according to Eq. (379) 

<(Ar !*)*, = 6 (402) 

and hence, for P defined as in Eq. (380) 

/ , = 0[(A/)‘] (A/—*0), (403) 

contrary to Eq. (401). However, the reason for 
this disagreement is that the reduction of the 
problem of Brownian motions to one in diffusion 
can be achieved only when the intervals of time 
we are interested in are long compared to the 
time of relaxation When this ceases to be 
the case, as in the present context, Eq. (379) is 
no longer true and we should strictly use the 
general distribution derived in Chapter II, 
§2 [see Eq. (171)]. And, according to Eq. (175) 

<! Ar| 2 )*, = |u 0 | l (A/) 2 , (A/—*0). (404) 

On the basis of Eq. (404) we shall naturally be 
led to a formula for P consistent with (401) 
[see Eq. (413) below]. We shall therefore 
assume that 


P(A/) = /> 0 A/ + O(A/ 2 ) (A/—*0), (405) 

where P 0 is a constant. 

( ombining Eqs. (400) and (405) we have 

0n(OA/»[l-(n + O/ , oA/ + O(A/*)]« A * 

X (n + v)P 0 A/, (406) 

or, passing to the limit A/ = 0 we obtain 

4>n(t)dl = ex p [ — (« + v)Pd ](» + »>) P<dt. (407) 


Equation (407) expresses a law of decay of a 
stale of fluctuation quite analogous to the law of 
decay of radioactive substances. 

According to Eq. (407), the mean life, T n , 
of the state n for continuous observation can be 
defined by 

in other words 


-I 
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t<t>n(t)dt: 


(408) 


T u =\/(n + v)P 0 . (409) 


Equation (409) is our present analogue of the 
formula (368) valid for intermittent observations. 


Again, as in §1, we can also define the average 
time of recurrence of a state of fluctuation for 
continuous observation. This can be done by 
introducing the probability W(Nn ; Nn) and 
proceeding exactly as in the discussion of 
However, without going into details, it is 
evident that the relation (37 7) between / „ and 
H, must continue to be valid, also for the case of 
continuous observation. Hence 

1 1 - U r (n) 

(->, =--. (410) 

(n + »)P 9 HP(«> 

W e shall now derive for the case of Brownian 
motions, an explicit formula for P„ which we 
formally introduced in Eq. (405). As we have 
already remarked, when dealing with continuous 
observation, the idealization of the phenomenon 
of Brownian motion as pure diffusion is not 
tenable. Instead, we should base our discussion 
on the exact distribution function \V(t, t \ r 0 , u 0 ) 
given by Eq. (171) and which is valid also for 
times of the order of the time of relaxation 3 '. 
However, since we are only interested in P(A/) 
for A/—»0 it would clearly be sufficient to con¬ 
sider the limiting form of the exact distribution 
H'(r, u, /; r 0 , u 0 ) as t—*0. On the other hand 
according to Eqs. (170)-(175) it follows that 
as /—»() we can regard the particles as describing 
linear trajectories with a Maxwellian distribu¬ 
tion of the velocities. Hence, in our present 
context, /’(A/) represents the probability that a 
particle initially inside a given element of 
volume v (with uniform probability) and with a 
velocity distribution governed by Maxwell’s 
law will emerge from v before a time A/. It is 
clear that formally, this is the same as the num¬ 
ber of molecules striking the inner surface of the 
element of volume considered in a time A t when 
the molecular concentration is 1 fv. 


1 able VII. I he mean life T n and the average time of 
recurrence (P = 0.726; 1.55). (7\, and «, arc ex¬ 

pressed in units of r.) 


T -(obs.) r«(calc.) H.(obs-) H»(calc.) 


0 1.67 1.47 

1 1.50 1.55 

2 1.37 1.38 

3 1.25 1.23 

4 1.23 1.12 


6.08 

3.13 

4.11 

7.85 

18.6 


5.54 

3.16 

4.05 

8.07 

20.9 
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Now, according to calculations familiar in the 
kinetic theory of gases, the number of molecules 
with velocities between u and u + d u 
which strike unit area of any solid surface per 
unit time and in a direction with a solid angle 
dV. at an angle d with the normal to the surface 
is given by 

A (»i ' 2irk 7 ) * exp ( — m | u - '2kT) 

X u, 3 cost Mild U:. (411) 

where A denotes the molecular concentration. 
Hence, 

P(A0=A/-(——) £ exp ( — w | u 1 2 /2kT) 

X u | 3 cos ddild u ( , (412) 

where a is the total surface area of the element 
of volume v. On evaluating the integrals in 
Eq. (412) we find that 

P(A/) = (a/v)(kT/2irm)tAt. (413) 

Comparing this with Eq. (405) we conclude that 
for the case under consideration 

Po= (<r/v)(kT/2irmy. (414) 

The formulae (409) and (410) for the mean 
life and the average time of recurrence now take 
the forms 

T „ = (v o(n + v))(2irm kT)\ (415) 

and 

0 B =(t'/ff(n + f))(25rw; kT )* 

X([l -W{n)-\/W(n)). (416) 


Table VIII. The average time of recurrence of a state of 
fluctuation in which the molecular concentration in a 
sphere of air of radius a will differ from the average value 
by 1 percent. r = 300°K; v = 3X 10 ,# X (4ira73). 


"(cm) 1 5 X 10~* 3X10-* 2.5 XIO"* 1X10“* 

H(sec.) 10 10 10“ 10* 1 io~ 11 


sider, following Smoluchowski, the average time 
of recurrence of a state of fluctuation in which 
the molecular concentration of oxygen in a 
sphere of air of radius a will differ from the 
average value by 1 percent. Table VIII gives 
0, for different values of a. 

It is seen from Table VIII that under normal 
conditions, for volumes which are on the edge 
of visual perception even appreciable fluctuations 
in the molecular concentrations require such 
colossal average times of recurrence, that for all 
practical purposes the phenomenon of diffusion 
can be regarded as an irreversible process. On 
the other hand, for volumes which arc just on the 
limit of microscopic vision, fluctuations in 
concentrations occur to such an extent and with 
such frequency that there can no longer be any 
question of irreversibility: under such conditions 
the notion of diffusion very largely loses its 
common meaning. For example, it would scarcely 
occur to one to illustrate the phenomenon of 
diffusion by the experiments of Svedberg and 
Westgren on colloid statistics though it is in 
fact true that on the average the results are in 
perfect accord with the principles of macro¬ 
scopic diffusion [as is illustrated, for example, by 
Eq. (356) for (A n )»,]. YVe shall return to these 
questions in the following section. 


The case of greatest interest arises when the 
average number of particles, v, contained in v 
is a very large number and the values of n con¬ 
sidered are relatively close to v. Then, the 
Poisson distribution W(n) simplifies to (see 
Appendix III) 

W{n) = \_\/{2TT V y] exp [ — (n — vj l /2v~\. (417) 

On this approximation, Eq. (416) becomes 

v / m \ * 

Mn-ir-l -) exp [(« — v) 2 /2v~\. (418) 

As an illustration of Eq. (418) wc shall con- 


4. On the Reversibility of Thermodynamically 
Irreversible Processes, the Recurrence of 
Improbable States, and the Limits of Validity 
of the Second Law of Thermodynamics 

If we formulate the second law of thermo¬ 
dynamics in any of its conventional forms, as, for 
example, that "heat cannot of itself be trans¬ 
ferred from a colder to a hotter body" or, that 
"arbitrarily near to any given state there exist 
states which are inaccessible to the initial state 
by adiabatic processes” (Caratheodory), or that 
"the entropy of a closed system must never 
decrease," we, at once, get into contradiction 
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with the kinetic molecular theory which demands 
the essential reversibility of all processes, ( on- 
sequently, from the side of "dogmatic” thermo¬ 
dynamics two principal objections have been 
raised in the form of paradoxes and which are 
held to vitiate the entire outlook of the kinetic 
theory and statistical mechanics. We lirst state 
the two paradoxes. 

(*) Loschmidi's Reversibility Paradox 

Loschrnidt first drew attention to tin fact 
that in view of the essential svmmetrv of the 
laws of mechanics to the past and the future, 
all molecular processes must be reversible from 
the point of view of statistical mechanics. This 
is in apparent contradiction with the point of 
view held in thermodynamics that certain 
processes are irreversible. 

(ii) Zermelo’s Recurrence Paradox 

I here is a theorem in dynamics due to Poin¬ 
care which states that in a system of material 
particles under the influence of forces which de¬ 
pend only on the spatial coordinates, a given 
initial state 1 must, in general, recur, not exactly, 
but to any desired degree of accuracy, infinitely 
often, provided the system always remains in the 
finite part of the phase space. (For a proof of this 
theorem see Appendix V.) In other words, the 
trajectory described by the representative point 
in the phase space has a "quasi-periodic" 
character in the sense that after a finite interval 
of time (which can be specified) the system will 
return to the initial state to any desired degree 
of accuracy. Basing on this theorem of Poin- 
car6, Zermelo has argued that the notion of irre¬ 
versibility fundamental to macroscopic thermo¬ 
dynamics is incompatible with the standpoint 
of the kinetic theory. 

As is well known, Boltzmann has tried to 
resolve these paradoxes of Loschrnidt and 
Zermelo by probability considerations of a 
general nature. Thus, on the strength of certain 
rough estimates (see Appendix VI). Boltzmann 
concludes that the period of one of Poincare’s 
cycles is so enormously long, even for a cubic 

7 1 his is defined by t he jjositions and the velocities of all 
the particles, i.e., by the representative point in the phase 

voice 1 * 


centimeter of gas, that the recurrence of an 
initially improbable state (i.e., the reversal to 
a state of lower entropy) while not strictly 
impossible, is yet so highly improbable that 
during the times normally available for observa¬ 
tion, the chance of witnessing a thermodynam¬ 
ically irreversible process i> extremely small. 

1 hough Boltzmann’s arguments and conclu¬ 
sions niv fundamentally sound there are certain 
unsatLlui lory features in basing on the period 
of a Poincare cycle For one thing, the period of 
such a cycle depends on how nearly we (arbi¬ 
trarily) require the initial state to recur. Again, 
Poincare's theorem refers to the return of the 
representative point in the 6.V-dimensional 
phase space (A' denoting the number of particles 
in the system). Actually, in practice, we should 
treat two states of a gas as macroscopicallv dis¬ 
tinct only il the numbers of molecules (considered 
indistinguishable) in the various limits of posi¬ 
tions and velocities are different. Then, during a 
Poincare cycle, the different macroscopicallv 
distinguishable states of the system will ap¬ 
proximately recur a great mans times. These 
recurrences of the different macroscopicallv 
distinct states, during a given Poincar£ cycle, 
will be distributed very unequally among the 
states: thus, most of the recurrences will occur 
for the states of the system which are very close 
to what would be described as the thermo¬ 
dynamically “normal state." Moreover, it can 
also happen that during such a cycle, states 
deviating by arbitrarily large amounts from the 
normal state are assumed by the system. In 
other words, during a Poincare cycle we shall 
pass through many improbable states and indeed 
with equal frequency both in the directions of 
increasing and decreasing entropy. 

Thus, while we may accept Boltzmann’s 
point of view as fundamentally correct, it would 
clearly add to our understanding of the whole 
problem if we can explicitly demonstrate in a 
given instance how in spite of the essential 
reversibility of all molecular phenomena, we 
nevertheless get the impression of irreversibility. 

Now, as we have already remarked in the 
preceding sections, Smoluchowski's theory of 
fluctuations in molecular concentrations allows 
us to bridge the gap between the regions of the 
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macroscopically irreversible diffusion and the 
microscopically reversible fluctuations. Conse¬ 
quently, a further discussion of this problem 
will enable us to follow explicitly how in this 
particular instance the Loschmidt and the 
Zermelo paradoxes resolve themselves. 

(a) The resolution of Loschmidt's paradox .— 
l sing hqs. (333), (344), and (345) we readily 
verify that 

//(«, n + k) = W(n)W(n-,n+k) 

= W(n + k) W(n + k\ n) = II(n + k, n). (419) 

1 he quantity on the left-hand side in the fore¬ 
going equation represents the frequency of 
occurrence of the numbers n and n + k on two 
successive occasions in a long sequence of ob¬ 
servations; similarly, the quantity on the right- 
hand side gives the frequency of occurrence of 
the pair (w-f k, n). It therefore follows that under 
equilibrium conditions, the probability, that in 
a given length of time we observe a transition 
from the state n to the state m is equal to the 
probability that (in an equal length of time) 
we observe a transition from the state m to the 
state n. It is precisely the symmetry between 
the past and the future which guarantees this 
equality between II(n;m) and //(m;n). A 
glance at Table VI shows that this is amply 
confirmed by observations. [It may be further 
noted that, in accordance with Eq. (419) the 
numbers in italics on the opposite sides of the 
principal diagonal are equal.] All this, is, of 
course, in entire agreement with Loschmidt’s 
requirements. 

On the other hand, it is also evident from 
Table VI, that after a relatively large number 
like 5, 6, or 7 a number much smaller, generally 
follows; in other words, the probability that a 
number n(»»') will further increase on the next 
observation is very small indeed. This circum¬ 
stance illustrates how molecular concentrations 
differing appreciably from the average value will 
almost always tend to change in the direction 
indicated on the macroscopic notions concerning 
diffusion [cf. Eq. (356)]. 'This corresponds 
exactly to one of Boltzmann’s statements that 
the negative entropy curve almost always 
decreases from any point. However this may be, 
in course of time, an abnormal initial state will 


again recur as a consequence of fluctuations, 
and we shall now see how in spite of this possi¬ 
bility for recurrence, the apparently irreversible 
nature of the phenomenon comes into being. 

(b) The resolution of Zerrnelo's paradox. —Let 
us first consider the case of intermittent observa¬ 
tions. As we have already remarked in §2, the 
number 17 never occurred in one of Svedbcrg’s 
sequences for which v had the value 1.55. But 
the average time of recurrence for this state 
[according to Eq. (376)] is 10 ,3 r; and since 
r — 1/39 min., for the sequence considered, 
0^-500,000 years. Hence, the diffusion from the 
state n = 17 will have all the appearances of an 
irreversible process simply because the average 
time of recurrence is so very long compared to 
the times during which the system is under 
observation. 

Turning next to the case of continuous ob¬ 
servations, we shall return to the example con¬ 
sidered in §3. As we have seen (cf. Table VIII) 
the average time of recurrence of a state in 
which the number of molecules of oxygen 
contained in a sphere of radius a ^5X10 -6 cm 
(and 7'=300°K and i' = 3X10 19 cm -3 ) will 
differ from the average value by 1 percent is very 
long indeed (0> 10 68 seconds). The factor which 
is principally responsible for these large values 
for 0 is the exponential factor in Eq. (418). 
Accordingly, we may say, very roughly, that 
the second law of thermodynamics is valid only 
for those diffusion processes in which the equal¬ 
ization of molecular concentrations which take 
place are by amounts appreciably greater than 
the root mean square relative fluctuation (namely. 

[(| n — v\ 2 )*,/ 1 * 2 ] 1 = v - *)- We have thus completely 
reconciled (at any rate, for the processes under 
discussion) the notion of irreversibility which is 
at the base of thermodynamics and the essential 
reversibility of all molecular phenomena de¬ 
manded by statistical mechanics. This recon¬ 
ciliation has become possible only because we 
have been able to specify the limits of validity 
of the second law. 

Quite generally, we may conclude with Smolu- 
chowski that a process appears irreversible (or 
reversible) according as whether the initial state is 
c/mraclerized by a long (or short) average time of 
recurrence compared to the times during which the 
system is under observation. 
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5. The Effect of Gravity on the Brownian Motion: The Phenomenon of Sedimentation 

The study of the effect of gravity on the Brownian motion provides an interesting illustration of the 
use to which Smoluchowski’s equation [Eq. (312)] 

( du' dt) = divr (qd~- gradr w — K 8"'w) (420) 

can be put. In Eq. (420) K represents the acceleration caused by the external field of force. If the 
external field is that due to gravity, we can write 


K r = 0; K y — 0; K, = — ( 1 — (p u ; p))g, 


(421) 


provided the coordinate system has been so chosen th.it the z axis is in the vertical direction. In 
Eq. (421), g denotes the value of gravity, p the density of the Brownian particle and p 0 ( ^ p) that of 
the surrounding fluid. Hence, for the case (421), Eq. (420) becomes 

(dw/dt) = (q/(P)YHv+(l — (p 0 p))(g 0)(du>'dz). (422) 

It is seen that Eq. (422) is of the same general form as Eq. (126). Accordingly, we can interpret 
the phenomenon described by Eq. (422) as a process of diffusion in which the number of particles 
crossing elements of area normal to.*, y, and r directions, per unit area and per unit time, are given, 
respectively, by [cf. Eq. (127)] 

— D(dw dx), -D(dw dy). (423) 

and 

— D{dw/dz) —cw, (424) 

where 

D = (q '0r-) = (kT/m0) \ c= (1 - (p o /p))(*/0). (425) 

1 hus, while the diffusion in the (x, y) plane takes exactly as in the field free case, the situation in the 

2 direction is modified. If we. therefore, limit ourselves to considering only the distribution in the 

2 direction, of particles uniformly distributed in the ( x , y) plane, the appropriate differential equa¬ 
tion is 

dw dhu dw 

— = D - \-c —. (426) 

dt dz 2 dz K 1 

Let us now suppose that the particle is initially at a height c 0 measured from the bottom of the 
vessel containing the solution. Then, the probability of occurrence of the various values of 2 at 
later times will be governed by the solution of Eq. (426) which satisfies the boundary conditions 


iv—+6(z-z 0 ) as t—> 0 , 

D(dw/dz)+cu> = 0 at 2 = 0 for all /><). 


(427) 


I be second of two foregoing boundary conditions arises from the requirement that no particle shall 
cross the plane 2 = 0 representing the bottom of the vessel [cf. Eq. (424)]. 

fo,L°“ SOlUti .° n of , E ?- (426) satisfying the boundary conditions (427), we first introduce the 
o owing transformation of the variable [cf. Eq. (128)] 


f c c 2 

w= U(z, t) exp- (2 - 2 o)- 1 

12 D 4D . 


(428) 


Equation (426) reduces to the standard form 

(dU/dt)=D(d 2 U/dz 2 ) 

while the boundary conditions (427) become 


(429) 
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U—*6(z — s o) as /—*0, 

D(dU/dz) + (l/2)cC/=0 at 2 = 0 for all />0. 


(430) 


Solving Eq. (429) with boundary conditions of the form (430) is a standard problem in the theory of 
heat conduction. We have 


1 


£/ =--{exp [- (2-2o) 2 /4/)/] +exp [ - (z+z 0 y/4Dl ]} 


2 ( t rDty 


+ 


2D(irDt) 


c r 

I exp — 

nDty 


(q + 2 ) 2 c{a — z 0 ) 


4 Dt 


+ 


2/) 


j da. 


(431) 


After some elementary transformations, Eq. (431) takes the form 


1 

U — -{exp [-(2 — 2o) 2 /4£>/]+exp [-(z + So )2/4 Dt~]\ 

2(irDt ) J 


DV 


Returning to the variable iv we have []cf. Eq. (428)] 


c \cH c(2 + 2o) 

H-exp 


\C‘t c(z-tz 0 n r * 

-I exp ( — x 2 )dx. 

UD 2D }J,+ u - el 

2 (Dt)S 


(432) 


U'(l, 2; 2 0 ) = 


>(tt£>0 


{exp [-(2-2 0 )V4/9/] + exp [- (z + z 0 ) 2 /4Dt] 1 


Xe 


«pf~ 

L 2D 


(z-2 0 ) 


c 1 1 c r * 

- 1 +-expf-^Vx (433) 

AD\ DV* J t+U . cl 


2( Dt)\ 


which is the required solution. In Fig. 7 we have illustrated according to Eq. (433) the distributions 
w(z, /; 2 0 ) for a given value of z 0 and various values of /. 

If we suppose that at time / = 0 we have a large number of particles distributed uniformly in the 
plane z = z 0 then in the first instance diffusion takes place as in the field free case (curves 1 and 2). 
However, gravity makes itself felt very soon (curves 3, 4. and 5) and the maximum begins to be 
displaced to lower values of 2 with the velocity c; at the same time, the maximum becomes flatter 
on account of the random motions experienced by the particles. Once the probability of finding 
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particles near enough to the bottom of the vessel becomes appreciable, the curves again begin to 
rise upwards (curves 5 and 6) on account of the reflection which the particles suffer at 2 = 0; and, 
finally as /—»» we obtain the equilibrium distribution 


Since [cf. Eq. (425)] 


w(z, * ; s 0 ) = (c/D)e 




(c D) = (\ —(p 0 p))(mg kT), 


(434) 

(435) 


we see that the equilibrium distribution (434) represents simply the law of isothermal atmospheres in 
its standard form. 

The example we have just considered provides a further illustration of a case to which the con¬ 
ventional notions concerning entropy and the second law of thermodynamics cannot be applied, 
hor the state of maximum entropy for the system consisting of the Brownian particles and the sur¬ 
rounding fluid, is that in which all the particles are at 2 = 0; and, on strict thermodynamical principles 
we should conclude that with the continued operation of dissipative forces like dynamical friction, 
the state of maximum entropy will be attained. But according to Eq. (434), as though the 

state of maximum entropy 2 = 0 has the maximum probability, it is not true that the average value 

of the height at which the particles will be found is also zero. Actually, for the equilibrium distribu¬ 
tion (434), we have 

(z) ta = (D/c) = (*77wg)0/0>- Po )]. (436) 

which is the height of the equivalent homogeneous atmosphere. Moreover, even if the particles were 
initially at 2 = 0, they will not continue to stay there. For, setting 2 g = 0 in Eq. (433) we find that 


r 


(437) 


21 DiiS 


Equation (437) shows that as » we are again led to the equilibrium distribution (434) (see Fig. 8). 
Hence, the particles do a certain amount of mechanical work at the expense of the internal energy of the 
surrounding fluid; this is of course contrary to the strict interpretation of the second law of thermo¬ 
dynamics. The average work done in this manner is given by [if we use Eq. (436)] 

04)*, = m(l - (po/p))gz = kT, (438) 

per particle. Hence, on the average there is a decrease in entropy of amount k per particle: 


(S)*, = S m „-Nk, 


(439) 


where N denotes the number of Brownian particles. However, as Smoluchowski has pointed out 

r.,n T COne at the expense of the internal energy of the surrounding fluid cannot be utilized to 
run a heat engine with an efficiency higher than that of the Carnot cycle 

descend thal^hr T* “T 'u °' *' DU ' 3 particle has a neater probability to 

descend than ,t has to ascend. As 2-0 the converse .s true. We may therefore say that the tendency 

of th H e e e "r PV '° <almOSt always) for P articlcs at ^ compensated by the tendency 

of the entropy to decreese for particles very near 2 = 0; so that, on the average a steady 

Tre!" heights - but^' probability for Particles, occasionally io ascend to very 

of recur ence'for Inch h° T ” CO " cluS, ° ns of we should “pect that the average time 

ecurrence tor such abnormal states must be very long indeed. * 

6. The Theory of Coagulation in Colloids 

•tzzzzxi 1 jsse seises s?; ,t 
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solution. Smoluchowski s theory of this phenomenon is based on a suggestion of Zsigmondy that 
coagulation results as a consequence of each colloidal particle being surrounded (on the addition of 
an electrolyte) by a sphere of influence of a certain radius R such that the Brownian motion of a 
particle proceeds unaffected only so long as no other particle comes within its sphere of influence 
and that when the particles do come within a distance R they stick to one another to form a single 
unit. \\ e are not concerned here with the physico-chemical basis for Zsigmondy's suggestion except 
perhaps to remark that the spheres of influence are supposed to originate in the formation of electric 
double layers around each particle; we are here interested only in the application of the principles 
of Brownian motion which is possible on the acceptance of Zsigmondy’s suggestion. However, we 
may formulate somewhat more explicitly the problem we wish to investigate: 

We imagine that initially' the colloidal solution contains only' single particles all similar to one 
another and of the same spherical size. We now suppose that at time / = 0 an (appropriate) electrolyte 
is added to the solution in such a way that the resulting electrolytic concentration is uniform through¬ 
out the solution. I he particles are now supposed to be all instantaneously surrounded by spheres of 
influence of radius R. From this instant onwards, each particle will continue to describe the original 
Brownian motion only so long as no other particle comes within its sphere of influence. Once two 
particles do approach to within this distance R they will coalesce to form a “double particle.” This 
double particle will also describe Brownian motion but at a reduced rate consequent to its increased 
size. 1 his double particle will, in turn, continue to remain as such only' so long as it does not come 
within the appropriate spheres of influence of a single or another double particle: when this happens 
we shall have the formation of a triple or a quadruple particle; and, so on. The continuation of this 
process will eventually lead to the total coagulation of all the colloidal particles into one single mass. 

The problem we wish to solve is the specification of the concentrations v u v 3 , v 3 , v it • • - , of single, 
double, triple, quadruple, etc., particles at time t given that at time t = 0 there were *' 0 (=^i[0]) 
single particles. 

As a preliminary to the discussion of the general problem formulated in the preceding paragraph 
we shall first consider the following more elementary situation: 

A particle, assumed fixed in space, is in a medium of infinite extent in which a number of similar 
Brownian particles are distributed uniformly at time / = 0. Further, if the stationary particle is 
assumed to be surrounded by a sphere of influence of radius R what is the rate at which particles 
arrive on the sphere of radius R surrounding the fixed particle? 

We shall suppose that the stationary particle is at the origin of our system of coordinates. Then, 
in accordance with our definition of a sphere of influence, we can replace the surface |r| =R by a 
perfect absorber [cf. I, §5, see particularly Eq. (115)]. We have therefore to seek a solution of the 
diffusion equation [cf. Eqs. (173) and (306)] 


( dw/dt ) = nv'w ; D = (q/F) = {kT/tira v ), 

which satisfies the boundary conditions 

w= v = constant, at 1 = 0, for |r|>/?, 
w = 0 at |r| =R for />0. 

In the first of the two foregoing boundary conditions v denotes the average concentration of the 
particles exterior to |r| =R at time / = 0. 

Since w can depend only on the distance r from the center, the form of the diffusion equation 
(440) appropriate to this case is 

(d/dl)(rw) =D(d*/dr*)(rw). (442) 

The solution of this equation satisfying the boundary conditions (441) is 


(440) 


(441) 
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w = v 


R 

1 - 


R 2 R r 

“+— { 
r r\ r 


X.T—R)!HDl) I 


exp (— x 2 )dx 


( 443 ) 


From Eq. (443) it follows that the rate at which particles arrive at the surface r| = R is given by 
[cf. Eq. (117)] 


4 tDI r 3 


( r- — \ =4 wDRu( 1 +-) 

\ dr / r ^ft \ (irDt)W 


444 ) 


Equation (444) gives the rate at which particles describing Brownian motion will coalesce with a 
stationary particle surrounded by a sphere of influence of radius R. Suppose, now, that the particle 
we have assumed to be stationary is also describing Brownian motion. What is the corresponding 
generalization of (444)? In considering this generalization we shall not suppose that the diffusion 
coefficients characterizing the two particles which coalesce to form a multiple particle are neces¬ 
sarily the same. Under these circumstances we have clearly to deal with the relative displacements 
of the two particles; and it can be readily show n that the relative displacements between two particles 
describing Brownian motions independently of each other and with the diffusion coefficients D\ and 
Di also follows the laws of Brownian motion with the diffusion coefficient £>,* = /.),+ D For, the 

probability that the relative displacement of two particles, initially, together at / = 0 , lies between 
r and r-\-dr is clearlv 


W(r)dr 




W x {rx)W 1 (r x + T)dr x 


dr 


Hromtw L exp( ~ jr,l ’ /4D,l) exp ( ~ |r ' + ' IV4ZW '- 

or, as may be readily verified [cf. the remarks following Eq. (62)] 

lV(r) = (l/[4r(D l + D 2 )l]i) exp (- | r |*/4(£> , + £>,)/). 


> (445) 


(446) 


On comparing this distribution of the relative displacements with the corresponding result for the 
individual displacements [see for example Eq. (172)] we conclude that the relative displacements do 
lollow the laws of Brownian motion with the diffusion coefficient (£>, + £> 2 ). 

1 hus, the required generalization of Eq. (444) is 


4ir(D|-F D 2 )Ri>{ 1 4 - V 

V IriDi + DJty/ 


(447) 


More generally, let us consider two sorts of particles with concentrations v, and u k . Let the respec- 

•ve diffusion coefficients be D t and D k . Further, let R* denote the distance to which two particles 

one o each sort) must approach in order that they may coalesce to form a multiple particle. Then 

e rate of formation of the multiple particles by the coagulation of the particles of the kind consid¬ 
ered is clearly given by 

Jx + kdt = AxD ik Ri k PiVk( Iff- \dt I AAO\ 

, V (icD ik t)w 

where we have written 

D,k = D, + D k . ( 449 ^ 

if Ea f ( 447 h r; ] h iSCUSSic ; nS ' W K e sha11 « no ? the ““nd ter ™ in the parenthesis on the right-hand side 
q. (447); this implies that we restrict ourselves to time intervals A l»R*/D. In most cases of 
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practical interest, this is justifiable as R-'D^ 10 3 —lO^ 4 second. With this understanding we can 
write 

J i + k dt^4irD ik R ik v i v k dt. (450) 

Using Eq. (450) we can now write down the fundamental differential equations which govern the 
variations of v )t v 2 . • • v k , ■ ■ ■ (of single, double, • • •, Mold, • • •,) particles with time: 

Thus, considering the variation of the number of Mold particles with time, we have in analogy 
with the equations of chemical kinetics 




4tt(£ E v l VjD IJ R ij — 

i+i-k 


Vk E VjD ki R kj ) 

i-i 


(Ml, •••). 


(451) 


In this equation the first summation on the right-hand side represents the increase in v k due to the 
formation of Mold particles by the coalescing of an t-fold and a ./-fold particle (with i+j = k), while 
the second summation represents the decrease in v k due to the formation of (£+j)-foId particles in 
which one of the interacting particles is Mold. 

A general solution of the infinite system of Eq. (451) which will be valid under all circumstances 
does not seem feasible. But a special case considered by Smoluchowski appears sufficiently illustra¬ 
tive of the general solution. 

First, concerning R XK , the assumption is made that 

R*=HRi+Rk), (452) 

where R , and Ri are the radii of the spheres of influence of the i-fold and the Mold particles. We can, 
if we choose, regard the assumption (452) as equivalent to Zsigmondy’s suggestion concerning the 
basic cause of coagulation. 

Again, according to Eq. (440), the diffusion coefficient is inversely proportional to the radius of the 
particle; and on the basis of experimental evidence it appears that the radii of the spheres of in¬ 
fluence of various multiple particles are proportional to the radii of the respective particles. We there¬ 
fore make the additional assumption that 

D x Ri = DR (t= 1, •••). (453) 

where D and R denote, respectively, the diffusion coefficient and the radius of the sphere of influence 
of the single particles. 

Combining Eqs. (449), (452), and (453) we have 

D ik R ik = \{D i +D k ){R % +R k ) = \DR{Rc x + Rk- x )(Ri+Rk) = \DR(R i +R k )*Rc'R k -'. (454) 


Finally, for the sake of mathematical simplicity we make the (not very plausible) assumption that 

R, = R*. (455) 

Thus, with all these assumptions 

D ik Rik = 2DR. (456) 

In view of (456), Eq. (451) becomes 


dv k * 

-= 8 irDR(\ E v x Vj—VkY v i) 

dl i+i-k i -1 


(Ml, •••)• 


If we now let 


t = 4 icDRt, 


(457) 


(458) 


Eq. (457) takes the more convenient form 

dv k 


oc 


= E v x v,-2vk E vj (k 

dr * f—i 


= 1, •••) 


(459) 
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From Eq. (459) we readily find that 


d * * * < * 

—( Z n) = Z Z *'»* / ; 2 Y Z *'**'». 

c// *-l i—1 J-1 t-I J-l 


= - ( Z n) 1 . 

fc-l 


> (460) 


or, 


z >*=- 

1 + V 0 T 


(461) 


remembering that at / = 0, Zn=i'o. 

Using the integral (461) we can successively obtain the solutions for n, v t , etc. Thus, considering 
the equation for vi we have £cf. Eq. (459)] 


ao 


dv\[dt = —2v\ Y J'* = — ‘(1 + vqt ); 


(462) 


in other words, 


vo 


vi = 


( 1 "h V 0 t) 2 


(463) 


again using the boundary condition that vi — vo at / = 0. Proceeding in this manner we can prove 
(by induction) that 

v t =i/o[(i'or)‘- 1 /(l+»'or)* +l ] (* = 1,2, ■••). (464) 

In. Fig. 9 we have illustrated the variations of Z* 7 *. v\, v 2 , • • • with time. We shall not go into the 
details of the comparison of the predictions of this theory with the data of observations. Such com¬ 
parisons have been made by Zsigmondy and others and the general conclusion is that Smoluchowski’s 
theory gives a fairly satisfactory account of the broad features of the coagulation phenomenon. 


7. The Escape of Particles over Potential Barriers 

As a final illustration of the application of the principles of Brownian motion we shall consider, 
following Kramers, the problem of the escape of particles over potential barriers. The solution to this 
problem has important bearings on a variety of physical, chemical, and astronomical problems. 

I he situation we have in view is the following: 

Limiting ourselves for the sake of simplicity to a one-dimensional problem, we consider a particle 
movmg in a potential field ®(x) of the type shown in Fig. 10; more generally, we may consider an 



Fig. 9. 


Fig. 10 
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cnscmb,e of I ,arllcIes niovin R in the potential field $(*) without any mutual interference. We suppose 
that the particles are initially caught in the potential hole at A. The general problem we wish to 

solve concerns the rate at which particles will escape over the potential barrier in consequence of 
Brownian motion. 

In the most general form, the solution to the problem formulated in the foregoing paragraph is 
likely to be beset with considerable difficulties. But a special case of interest arises when the height 
of the potential barrier is large compared to the energy of the thermal motions: 


m ()» k T. 


(465) 


Under these circumstances, the problem can be treated as one in which the conditions are quasi- 
statwnary. More specifically, we may suppose that to a high degree of accuracy a Maxwell-Boltzmann 
distribution obtains in the neighborhood of A. But the equilibrium distribution will not obtain for all 
values of x. For. by assumption, the density of particles beyond C is very small compared to the 
equilibrium values; and in consequence of this there will be a slow diffusion of particles (across C) 
tending to restore equilibrium conditions throughout. If the barrier were sufficiently high, this 
diffusion will take place as though stationary conditions prevailed. 

Assuming first that we are interested only in time intervals that are long compared to the time of 
relaxation we can use Smoluchowski's Eq. (312). Under stationary conditions, Smoluchowski’s 
equation predicts a current density j given by [cf. Eq. (316)] 


f 


= {kT/m)u'e m ^ !kT 


(466) 


B 


where, in the integral on the right-hand side, the path of integration of s from A to B is arbitrary. 
In our present case 0 is a constant and, since further we are dealing with a one-dimensional problem, 
we can express Eq. (466) in the form 


J = 


kT 

m/3 


u , e m^(x)lkT 


f. 


(467) 


(x) /k T(J£ 


Now, the number of particles v A in the vicinity of A can be calculated ; for, in accordance with our 
earlier remarks we shall be justified in assuming that the Maxwell-Boltzmann distribution 


dv A = U'Ae~ m * i,kT dx 

is valid in the neighborhood of A. If we now further suppose that 

yS—^ioA^x 2 (u3a = constant; x~0), 

-f* 


(468) 


we obtain from Eq. (468) 


va 


= iv A f exp (- mu) A 7 x 2 /2kT)dx, 


(469) 


(470) 


where the range of integration over x has been extended from — °c to + =c in view of the fact that the 
main contribution to the integral for v A must arise only from a small region near x = 0. Hence, 

va = (w A /cjA)(2irkT/m)y (471) 


Returning to Eq. (467), we can write with sufficient accuracy [cf. Eq. (469)]: 



B 


-i 


e m * ltT dx 


(472) 
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In writing Eq. (472) we have assumed that the density of particles near B is very small: this is true 
to begin with anyway. 

From Eqs. (471) and (472) we directly obtain for tl»e rate at which a particle, initially caught in 
the potential hole at A, will escape over the barrier at C, the expression 


/• c “ r 

y A 8 V lirm / \ J A 


B 


V'k 


T dx 


—! 


(473) 


I he principal contribution to the integral in the curly brackets in the foregoing equation arises 
from only a very small region near C [on account of the strong inequality (465)]. The value of the 
integral will therefore depend, very largely, only on the shape of the potential curve in the immediate 
neighborhood of C. If we now suppose that near x = xc, ^(x) has a continuous curvature, we may 
write 

Q — %uc 7 (x — xc) 2 (oic“constant; x-^xc)* 


(474) 


On this assumption, to a sufficient degree of accuracy we have 


J e ’n%rkT ( j x ^ e mQ,kT J exp [ — mwc*(jc — x c ) i /2kT'}dx, 


(475) 


= e^ ,kT (2 xkrimuc*)'. 


( ombining Eqs. (473) and (475) we obtain 


P={uKuc/2*P)e-’'^ kT , 


(476) 


which gives the probability, per unit time, that a particle originally in the potential hole at A, will 
escape to B crossing the barrier at C. 

I he formula (476) has been derived on the basis of Eq. (467) and this implies, as we have already 
remarked, that we are ignoring effects which take place in intervals of the order /3“*. Alternatively, 
we may say that the validity of Eq. (476) depends on how large the coefficient of dynamical friction 
0 is: if p were sufficiently large, the formula (476) for P may be expected to provide an adequate 
approximation [see Eqs. (507) and (508) below]. On the other hand, if this should not be the case, 
we must, in accordance with our remarks in C hapter II, §4, subsection (in), base our discussion of the 
generalized Liouville Eq. (249) in phase space; and in one dimension this equation has the form 


dW dW dlV dW d z W 

-(- u -1- K -= fiu -b /3 W -f q - 

dt dx du dn du 2 


(477) 


where it may be recalled that 


q = &(kT/m ); K=-(diU/dx). 


(478) 

In II, §5 w r e have shown that the Maxwell-Boltzmann distribution identically satisfies Eq (249) 
Accordingly, 

W= C exp [— (mu 2 +2w53)/2fcr], (479) 

where C is a constant, satisfies Eq. (477). However, under the conditions of our problem the equi¬ 
librium distribution (479) cannot be vajid for all values of x; for, if it were, there would be no diffu¬ 
sion across the barrier at C and the conditions of the problem would not be met. On the other hand 

W , 6 f°,?f peC l t th f distri bution (479) to be realized to a high degree of accuracy in the neighborhood 
ot A. We, therefore, look for a stationary solution of Eq. (477) of the form 

W=CF(x, u) exp [ —m(tt 2 + 2$)/2fcr], 


(480) 
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where F(x, u ) is very nearly unity in the neighborhood of x = Q. Since we have further supposed that 
the density of particles in the region B is quite negligible, we should also require that F(x, «)—► 0 for 
values of .r appreciably greater than x = x c . We may express these conditions formally in the form 

F{x, «) —1 at .v~0, 

F(x, «)— 0 for x»x c . (481) 

We shall now show how such a function F(x, u) can be determined. 

First of all it is evident that for the purposes of determining the rate of escape of particles across 
the barrier at C it is particularly important to determine F accurately in this region. Assuming that 
in the vicinity of C, 53 has the form (474) and that stationary conditions prevail throughout, the 
equation for Win the neighborhood of x = x c becomes [cf. Eq. (477)]: 

dW dW dW d 2 W 

u—-+uSX - = @u - \-&W+q - , (482) 

dX du du du 2 

where for the sake of brevity, we have used 


X = x-x c . (483) 

According to Eqs. (474), (480), and (483) the appropriate form for W'valid in the region C, is 


W=Ce~^’ kT F{X, u) exp [- m{u 2 -u<?X 2 )/2kT~\. 
Substituting for W according to this equation in Eq. (482), we obtain 

dF dF d 2 F dF 

u - VufX — = q - du —. 

dX du du 2 du 


(484) 


(485) 


It is seen that F— constant satisfies this equation identically: this solution corresponds of course to 
the equilibrium distribution. However, the solution of Eq. (485) which we are seeking must satisfy 
the boundary conditions [cf. Eq. (481)] 

F(X,u)—> 1 as X—*— », 

F(X, ti)— >0 as X— 

Assume for F the form 

F=F(u-aX) = F(l) (say), 
where a is, for the present, an unspecified constant. Substituting this form of F in Eq. (485) we obtain 

dF d 2 F 

[(fl d)u — uc 2 *]— = q -. (488) 

d£ d? 

In order that Eq. (488) be consistent it is clearly necessary that [cf. Eq. (487)] 

[wc 2 /(a-£)] = a; (489) 

and in this case Eq. (488) becomes 

dF d 2 F 

-(a-d)£— = q -. (490) 

d £ de 

Equation (490) is readily integrated to give 

F=F 0 f exp [-(a-/3)( 2 /2qJd(, (491) 


(486) 

(487) 


where F 0 is a constant. On the other hand, according to Eq. (489) a is the root of the equation 
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i.e., 


a ! — a& — ojc 1 = 0; 


a=(/3/2)±([^/4] + u !c 1 )* 


(492) 

(493) 


If we choose for a the positive root, then 

a-0=(O/4]+wc*)‘-(0/2) 


(494) 


is also positive, and as we shall show presently, the solution (491) leads to an F which satisfies the 
required boundary conditions (486). For, by choosing 

F, = l(a-fi)/2xq]\ (495) 

and setting the lower limit of integration in Eq. (491) as — * we obtain the solution 


/a —1 9\ l r* 

= ^ — J J exp \_-{a-Q)?/2q~\dZ, 


(496) 


which satisfies the conditions 


F—*\ as £—»4-=° ; F—*0 as £—> — 


~X> 


(497) 


On the other hand, since £=u — aX and a( — E(/3/2)*-Fu>c 1 ]*-|-[0/2]) is positive, £—+-f * or — <x> is 
the same as X—* — «• or + «> ; in other words, the solution (496) for F satisfies the necessary boundary 
conditions (486). 

Combining Eqs. (484) and (496) we have, therefore, the solution 


IF= C[(a —/3)/2ir^]*e _ " <?/ ‘ r exp [ — m(n* — w c 2 A' 2 )/2^r]J" exp [ — (a — 0)t?/2q}d$. 

Equation (498) is, of course, valid only in the neighborhood of C. 

In the vicinity of A we have the solution [cf. Eqs. (469) and (479)] 

W=C exp £ —m(u*+«****)/2fe 7*3. 

Accordingly, the number of particles, v A , in the potential hole at A is given by 

*a— cr exp — m(u 2 +u) A 7 x 2 )/2kT^\dxdu, 


(498) 


(499) 


= C(2irkT/mo) A ). 


(500) 


(This equation will enable us to normalize the distribution in such a way so as to correspond to one 
particle in the potential hole: for this purpose we need only choose C=nui> A /2xkT.) 

Now, the diffusion current across C is given by 


or, using the solution (498), we have 


<-r 

—go 


W(X = 0; u)udu, 


( 501 ) 


j=C[(a-0)/2Tqye~ m( > lkT J duu exp ( — mu*/2kT) f <7$ exp [—(a —0){*/2g]. 

00 ^ —ao 

After an integration by parts, we find 

j=C[(a-p)/2irqy(kT/m)e - m ' 0/ * T J exp { -u 2 [m/2kT+ (a-0)/2q]\du. 


(502) 


( 503 ) 
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But [cf. Eq. (478)] 


{m/2kT) + l{a-0)/2q-]={a/2q). 


From Eqs. (503) and (504) we now obtain 


(504) 


j = C(kT/m)[(a-0)/a']'e- mQ,kT . 

Hence, the rate of escape of particles across C is given by 

P = 07 *a) = (uA/2ir)[(a — 0)/aye- mQlkT , 

or, substituting for a and a-0 according to Eqs. (493) and (494), we find after some elementary 
reductions, that 

F= (oj . 4 / 2 ^ 100 ) (C/5 2 /4-f-we 2 ]* — C/3/2])e -m< 3 /tr . (507) 

/5»2 wc (508) 

we readily verify that our present “exact” formula for P reduces to our earlier result (476) derived 
on the basis of the Smoluchowski equation. But (507) now provides in addition the precise condition 
for the approximate validity of (476). On the other hand, for 0—»0 we have 


(505) 

(506) 


P=(u>a/ 2ir)e—«/*r (/3-»0). 


(509) 


1 his last formula for P valid in the limit of vanishing dynamical friction, corresponds to what is 
sometimes called the approximation of the transition-state method. 


CHAPTER IV 

PROBABILITY METHODS IN STELLAR DYNAMICS: 

THE STATISTICS OF THE GRAVITATIONAL 

FIELD ARISING FROM A RANDOM DISTRIBU¬ 
TION OF STARS 

1. Fluctuations in the Force Acting on a Star; 

The Outline of the Statistical Method 

One of the principal problems of stellar 
dynamics is concerned with the analysis of the 
nature of the force acting on a star which is a 
member of a stellar system. In a general way, it 
appears that we may broadly distinguish be¬ 
tween the influence of the system as a whole and 
the influence of the immediate local neighbor¬ 
hood ; the former will be a smoothly varying 
function of position and time while the latter 
will be subject to relatively rapid fluctuations 
(see below). 

Considering first the influence of the system 
as a whole, it appears that we can express it in 
terms of the gravitational potential 33(r;/) de¬ 
rived from the density function n(r, M ; /) which 
governs the average spatial distribution of the 
stars of different masses at time /. Thus, 

Mn(j\, M; t) 

3$(r; t)= —G I I - dMdr u (510) 

Jo I ri — r | 


where G denotes the constant of gravitation. 
The potential 3$(r; /) derived in this manner may 
be said to represent the “smoothed out” distri¬ 
bution of matter in the stellar system. The force 
per unit mass acting on a star due to the “system 
as a whole” is therefore given by 

K= — grad 33(r; /). (511) 

However, the fluctuations in the complexion 
of the local stellar distribution will make the 
instantaneous force acting on a star deviate 
from the value given by Eq. (511). To elucidate 
the nature and origin of these fluctuations, we 
surround the star under consideration by an 
element of volume a, which we may suppose is 
small enough to contain, on the average, only a 
relatively few stars. The actual number of 
stars, which will be found in a at any given 
instant, will not in general be the average num¬ 
ber that will be expected to be in it, namely an ; 
it will be subject to fluctuations. These fluctua¬ 
tions will naturally be governed by a Poisson 
distribution with the variance an [see Eq. (333)]. 

It is in direct consequence of this changing 
complexion of the local stellar distribution that 
the influence of the near neighbors on a star is 
variable. The average period of such a fluctua¬ 
tion is readily estimated: for the order of 
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magnitude of the time involved is evidently that 
required for two stars to separate by a distance 
equal to the average distance P between the 
stars (sec Appendix \ 11). We may, therefore, 
expect that the influence of the immediate neigh¬ 
borhood will fluctuate with an average period of 
the order of 

(512) 

where (j V 1 ) fc * denotes the root mean square- 
relative velocity between two stars. 

In the neighborhood of the sun, D " 3 parsecs, 

(I KI *)*.* — 50 km/sec. Hence 

T (near the sun)— 6X10 4 years. (513) 

When we compare this time with the period of 
galactic rotation (which is about 2 x10 s years) 
we observe that in conformity with our earlier 
remarks, the fluctuations in the force acting on a 
star due to the changing local stellar distribution 
do occur with extreme rapidity compared to the 
rate at which any of the other physical param¬ 
eters change. Accordingly we may write for the 
force per unit mass acting on a star, the ex¬ 
pression 

ft-tf(r;/) + /(/), (514) 

where K is derived from the smoothed out dis¬ 
tribution [as in Eqs. (510) and (511)] and F 
denotes the fluctuating force due to the near 
neighbors. Moreover, if A/ denotes an interval 
of time long compared to (512), we may write 


where 


ftA(=^A/ + 5(/ + A(;/), 

l+Al 


(515) 


o(* + A/ 




(A t»T). (516) 


Under the circumstances stated (namely, Ai»7 ) 
the accelerations 5(/-|-A/; /) and 5(/ + 2A(;/-f- A/) 
suffered during two successive intervals (/d-A/, l) 
and (/ + 2A(, /-f-A/) will not be expected to show 
any correlation. We may, therefore, anticipate 
the existence of a definite law of distribution 
which will govern the probability of occurrence 
of the different values of 5(f + A/;f). We thus 
see that the acceleration which a star suffers 
during an interval A/»! can be formally ex¬ 
pressed as the sum of two terms: a systematic 
term Kkl due to the action of the gravitational 
field of the smoothed out distribution, and a 


stochastic term S(/ + A/;/) representing the in¬ 
fluence of the near neighbors. Stated in this 
fashion, we recognize the similarity 8 between our 
present problems in stellar dynamics and those 
in the theory of Brownian motion considered in 
Chapters II and III. One important difference 
should however be noted: Under our present 
circumstances it is possible, as we shall presently 
s»e. to undertake an analysis of the statistical 
properties of Fit) and fff/TA/;/) based on first 
principles and without appealing to any “intui¬ 
tive” or a priori considerations as in the dis¬ 
cussions of Brownian motion [see the remarks at 
the end of II. §1 and also those following 
Eq. (318)]. 

We shall now outline a general method which 
appears suitable for analyzing the statistical 
properties of F. 

The force F acting on a ‘-tar. per unit mass, is 
given by 

M, 

F = CZ- (517) 

• |r,! a 

where .1/, denotes the mass of a typical “field’’ 
star and r, its position vector relative to the 
star under consideration; further, in Eq. (517) 
the summation is to be extended over all the 
neighboring stars. The actual value of F given 
by Eq. (517) at any particular instant of time 
will depend on the instantaneous complexion 
of the local stellar distribution; it is in conse¬ 
quence subject to fluctuations. We can therefore 
ask only for the probability of occurrence, 

l V(F)dF z dF u dF,= W(F)dF, (518) 

of F in the range F and F+dF. In evaluating 
this probability distribution, we shall (consistent 
with the physical situations we have in view) 
suppose that fluctuations subject only to the 
restriction of a constant average density occur. 

The probability distribution \V(F) of F can be 
obtained by a direct application of Markoff’s 
method outlined in Chapter I, -§3. We shall 
obtain the explicit form of this distribution 
(sometimes called the Holtsmark distribution) 
in §2 below, but we should draw attention, 
already at this stage, to the fact that the speci¬ 
fication of W(F) does not provide us with all the 


•Cf. particularly Eq. (317) and Eq. (515) above. 
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necessary information concerning the fluctuating 
force F for an equally important aspect of F 
concerns the speed of fluctuations. 

According to Eq. (517) the rate of change of F 
with time is given by 



— G Y. 

i 



(519) 


where V, denotes the velocity of a typical field 
star relative to the star under consideration. It 
is now clear that the speed of fluctuations in F 
can be specified in terms of the bivariate dis¬ 
tribution 

W(F,f) (520) 


infinity simultaneously in such a way that 

(4/3)irR>n = N 

(/?—>» ; TV—»co ; rc = constant). (522) 

This limiting process is permissible, in view of 
what we shall later show to be the case, namely, 
that the dominant contribution to F is made by 
the nearest neighbor [cf. Eqs. (560) and (564) 
below}; consequently, the formal extrapolation 
to infinity of the density of stars obtaining only 
in a given region of a stellar system can hardly 
affect the results to any appreciable extent. 

Considering first the distribution W S (F) at 
the center of a finite sphere of radius R and 
containing N stars, we seek the probability that 


which governs the probability of the simul¬ 
taneous occurrence of prescribed values for 
both F and /. It is seen that this distribution 
function I V(F,f) will depend on the assignment 
of a priori probability in the phase space in 
contrast to the distribution W(F) of F which 
depends only on a similar assignment in the 
configuration space. Again, it is possible by an 
application of Markoff’s method formally to 
write down a general expression for W(F, f ); but 
it does not appear feasible to obtain the re¬ 
quired distribution function in an explicit form. 
However, as Chandrasekhar and von Neumann 
have shown, explicit formulae for all the first 
and the second moments of / for a given F can 
be obtained; and it appears possible to make 
some progress in the specification of the sta¬ 
tistical properties of F in terms of these moments. 


F o ^F ^F 0 -\-dF 0 . (523) 

Applying Markoff s method to this problem we 
have [cf. Eqs. (51) and (52)} 

1 r +x 

W n (Fo) = — I exp (-ig*F 0 )A N ( 9 )d 9 , (524) 

07r 3 

where 

^(e) = n I / exp (ig*Fi) 
l JMi-oJ |r ,-1 -o 

Xr,(r„ Mi)dr4Mi ,. (525) 

In Eq. (525) r,(r„ Mi) governs the probability 
of occurrence of the zth star at the position r, 
with a mass M x . If we now suppose that only 
fluctuations which are compatible with a con¬ 
stant average density occur, then 


2. The Holtsmark distribution W(F) 

We shall now obtain the stationary distribu¬ 
tion W(F) of the force F acting on a star, per 
unit mass, due to the gravitational attraction 
of the neighboring stars. 

Without loss of generality we can suppose 
that the star under consideration is at the origin 
O of our system of coordinates. About O de- 
scribe a sphere of radius R and containing N 
stars. In the first instance we shall suppose that 

•v M x v 

F = GY. -r, = £/V (521) 

•-» J r. i 3 •-» 

But we shall subsequently let R and N tend to 


r.(r„ Mi) = (3/4 tR>)t(M), (526) 

where t(M) now governs the frequency of oc¬ 
currence of the different masses among the stars. 
With the assumption (526) concerning the r.’s 
Eq. (525) reduces to 

^A-(p) = r f f exp 

L47t/? 3 JM -o*/ f r | —o 

X r(M)drdM^ , (527) 

where we have written 

4 = GMt/\t\'. (528) 

We now let R and N tend to infinity according 
to Eq. (522). We thus obtain 
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I The foregoing expression is clearly unaffected 

VT(f)=— I exp ( — iQ m F)A(g)dQ, (529) jf we replace t by — t But this replacement 

changes exp(ip*^) into exp( — ig u 4) under the 


where ^ r 

A (p) = limit - I ) exp (to**D 

A_» x l4tt.R 3 Jm -o« 7 |r | «o 


] <T R*l»/* 

. (530) 


integral sign; taking the arithmetic mean of the 
two resulting integrals, we obtain 

r + * 

C(p) = [ 1 -cos 

•'-x (530) 


Since, 


4*-/? 


R Choosing polar coordinates with the s axis in 

f f T(M)dXIdr= 1. (531) the direction of p Eq. (539) can be transformed to 

-0*7 | r | —0 


* - + 1 


we can rewrite our expression for .-l(p) in the C ip) ’6 ' ■ 3 / 3 - I I I 
, o » / -i 


form 


® ~ ft 


/I (p) = limit f 1 -f f 


(3/) 


l-o 


I iw R*nl l 

. (532) 


X [ 1 — cos (|ol ili dwdld ! !, (540) 

or, introducing further the variable s=|p||^|, 
we have 

C(p) = 4G 3 ' 2 (AP'% |p| 3 ' 1 
The integral over r which occurs in Eq. (532) is .* -+-i _ 2 r 

seen to be absolutely convergent when extended X I [ 1 — cos (zl)^z~ ii2 dwdtdz. (541) 

over all |r|, i.c., also for |r|—»». We can ac- J -\ *'o 

cordingly write 

A (p) = limit [l-— f f r( M) 

L 4 tcR* jM -<W I r 1 -0 

] 4rflJn/3 

, (533) 


After performing the integrations over co and t 
we obtain 

C(p) = 2xG’ 3/I ( A/ 3/2 >*, | p | 1,2 


X J* (c —sin z)z~ 7l2 dz, (542) 


or 

where 


•4(p) =exp [-wC(p)], 


(534) Qr a f tcr several integrations by parts 

16 
15 


J ’.* 16 r c 

r(A/)[l-exp (fp^)]JrJA/. C(p) = — 2rC 3 ' 2 <3/ 3 '%| p| 3/2 z~''* cos zdz. 

m -o»' |r I -0 (535) 15 •'o 


In the integral defining C(p) we shall intro¬ 
duce 5 J as the variable of integration instead of r. 
We readily verify that 

dr = —\{GM) zn | <J | -'"d <J. (536) 

Hence, 

C(p) = *C 3 ' 2 f f 

*^0 •'-xj 

x[l —exp (tp*^)], (537) 

or, in an obvious notation 

C(g) = *G 3 '*<M«'% J^Cl-exp (*W)] 


(543) 


= —(27rG) 3 ' 2 <Af 3 ' 2 >A,|p| 3 ' 2 . 
15 


Combining Eqs. (529), (534), and (543) we 
now obtain 


-9/2 


--f 

Ktt-3 J 


4-oo 


W(F) = — I exp (— tp »F — a | p 1 3 / 2 )dp, (544) 

87T 3 J 


where we have written 

a = (4/15) (2xG) 3/2 ( A/ 3/2 >A,n. 


(545) 


Using a frame of reference in which one of the 
X I i\~ 9l2 d^. (538) principal axes is in the direction of F and chang- 
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inp to polar coordinates, the formula (544) for 
W(F) can be reduced to 

1 r” r +I 

ir(F) = — I I exp ( — zip, F t-a n 1 3 / 2 ) 

**7T‘ *^0 c/_j 

x | P1 2 dtd | O I. (546) 

'Hie integration over / is readily effected, and we 
obtain 


\V(F) = 




exp (-fl ip, 3 ' 2 ) 


X|o[ sin (|pi F )d\ 9 \. (547) 

It we now put 

*=|o||F|, (548) 

Eq. (547) becomes 


The asymptotic behavior of the distribution 
W (\ FI) can be obtained from the formulae: 


and 


II(f}) = 4 S 1 /3ir+0(f}') (0-> O ), (556) 


H(B) = (15/8)(2/ir ) 1,! i8- s ' 2 +0(/J-<) 

(0—®). (557) 

We find [cf. Eqs. (551) and (555) J 

mifl)^(4/3 r Q„>)IFI, (|FJ—>0), (558) 

and 

\V( | F |)^(15/8)(2/tt) 1/2 <2// 3/2 \F\-m 

(I FI ->cc). (559) 



exp (-ax 3 '-/\F : 3/2 ) 
X.r sin 


Substituting for ()„ from Eq. (550) in Eq. (559) 
we obtain 

(549) W( 1F1 ) ~ 2 ^ 3/2 (^ 3/ %« I F | -5/2 


We can rewrite the foregoing formula for W(F) 
more conveniently if we introduce the normal 
field Qn defined by 

Qu = a 713 = (4/15) 7l3 (2xG)((Al 3l7 ) A ,n) 7 ' 3 , 

= 2.603 U7((3/ 3/2 ) a ,«) 2/3 j 

and express | F| in terms of this unit: 

(550) 

\F\ =PQ,i = 8a 2/3 . 

(551) 

Equation (549) now takes the form 


W(F) = Il(0)/4xa 7 8 2 , 

(552) 

where we have introduced the function 
defined by 

im 

2 

H(8) = — 1 exp l-(x/8 ) 3/2 > sin xdx. 
x8 Jo 

(553) 

Since, 


W(\F\)=4x\F\ 7 W(F), 

(554) 

we obtain from Eqs. (551) and (552) 


IT( j F |) =H(8)/Qh ; 

(555) 


accordingly Ii(8) defines the probability distri¬ 
bution of | FI when it is expressed in units of 
Qh- The function 11(8) has been evaluated 
numerically and is tabulated in Table IX. 


(l^l — «). (560) 

It is seen that while the frequency of occur¬ 
rence of both the weak and the strong fields is 
quite small, it is only the fields of average in¬ 
tensity which have appreciable probabilities. 
In particular, the value of |F| which has the 
maximum probability of occurrence is found to 
be (see Table IX) ^1.6@//. 

Equations (552) and (553) provide, of course, 
the exact formula for the distribution of F for 
an ideally random distribution of stars. But an 
elementary treatment which leads to an ap¬ 
proximate formula for IV(F) is of some interest 
and illuminates certain points in the theory. 

T he treatment we refer to is based on the assump¬ 
tion that the force acting on a star is entirely 
due to its nearest neighbor. 

Now, the law of distribution of the near¬ 
est neighbor is given by fsee Appendix VII, 

Eq- (671)] 

w(r)dr = ex p ( — 4irr 3 n/3)4irr 7 ndr, (561) 
and, since on the first neighbor approximation 

\F\=GMr~ 7 , (562) 

we readily obtain the formula 

W(\F\)d\F\ =exp [-4x(GM) 3l7 n/3 1 F | */’] 

X 2x(GM) *'bi\F\~ 6/i d | FI. (563) 
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Table IX. The function 


0 

//(d) 

d 

//(d) 

0.0 


5.0 

0 04310 

0.1 

0.004225 

5.2 

0.03790 

0.2 

0.016666 

5.4 

0.03357 

0.3 

0.036643 

5.6 

0.02993 

0.4 

0063084 

5.8 

0.02683 

0.5 

0.094601 

6.0 

0.02417 

0.6 

0.129598 

6.2 

0.02188 

0.7 

0.166380 

6.4 

0.01988 

0.8 

0.203270 

6.6 

0.01814 

0.9 

0.238704 

6.8 

0.01660 

1.0 

0.271322 

7.0 

0.01525 

1.1 

0,30003 

7.2 

0.01405 

1.2 

0.32402 

7.4 

0.01297 

1.3 

0.34281 

7.6 

0.01201 

1.4 

0.35620 

7.8 

0.01115 

1.5 

0.36426 

8.0 

0.01038 

1.6 

0.36726 

8.2 

0.00967 

1.7 

0.36566 

8.4 

0.00903 

1.8 

0.36004 

8.6 

0 00846 

1.9 

0.35101 

8.8 

0 00793 

2.0 

0.33918 

9.0 

0.00745 

2.1 

0.32519 

9.2 

0.00701 

2.2 

0.30951 

9.4 

0.00660 

2.3 

0.29266 

9.6 

0.00622 

2.4 

0.27485 

9.8 

0.00588 

2.5 

0.25667 

10.0 

0 00556 

2.6 

A M 

0.238 

15.0 

0.00188 

2.7 

0.222 

20.0 

0.00089 

2.8 

0.206 

25.0 

0.00050 

2.9 

0.190 

30.0 

0.00031 

3.0 

0.176 

35.0 

0.00021 

3.2 

0.150 

40.0 

0.00015 

3.4 

0.128 

45.0 

0.00011 

3.6 

1 n 


50.0 

0.00009 

3.8 

4 


60.0 

0.00005 

4.0 


70.0 

0.00004 

4.2 


80.0 

0.00003 

4.4 

0.06734 

90.0 

0.00002 

4.6 

0.05732 

100.0 

0.00002 

4.8 

0.04944 




According to the distribution (563) 

W(\F\)^2w(GMyi*n\F\-'i' (|F| —«), (564) 

whidi is seen to be in exact agreement with the 
formula (560) derived from the Holtsmark 
distribution (555). The physical meaning of this 
agreement, for I/m—»=c in the results derived 
from an exact and an approximate treatment of 
the same problem, is simply that the highest 
fields are in reality produced only by the nearest 
neighbor. More generally, it is found that the 
two distributions (555) and (563) agree over 
most of the range of \F\. Thus, the field which 
has the maximum frequency of occurrence on the 
basis of (563) is seen to differ from the corre¬ 
sponding value on the Holtsmark distribution 
by less than five percent. The region in which the 
two distributions (555) and (563) differ most 


markedly is when F\-*0: on the Holtsmark 
distribution W 7 ( j F ) tends to zero as j F| 2 while 
on the nearest neighbor approximation \V(\F\) 
tends to zero as exp ( — const. | | ~ ) [cf. Fqs. 

(558) and (564)]. However, the fact that the 
nearest neighbor approximation should be seri¬ 
ously in error for the weak fields is, of course, to 
be expected for, a weak field arises from a more 
or less symmetrical, average, complexion of the 
stars around tin one under consideration and 
consequently F under these circumstances is the 
result of the action of several stars and not due 
to any one single star. 

Finally, we may draw attention to one im¬ 
portant difficulty in using the Holstmark dis¬ 
tribution for all values of F \ : It predicts 
relatively too high probabilities for F| as 
F — ‘x. I hus, on the basis of the distribution 
(555), ( FI 2 ;*, is divergent. [The same remark 
also applies to the distribution (564).] These 
relatively high probabilities for the high field 
strengths i> a consequence of our assumption of 
complete randomness in stellar distribution for 
all elements of volume. It is, however, apparent 
that this assumption cannot be valid for the 
regions in the very immediate neighborhoods of 
the individual stars. For, if V denotes the rela¬ 
tive velocity between two stars when separated 
by distances of the order of the average distance 
between the stars, the two stars cannot come 
closer together (on the approximation of linear 
trajectories) than a certain critical distance 
r( | V\ ) such that 

I F| 2 /2 = \_G(M 1 4-3/ 3 )/r(| Kj)], (565) 

or 

r( \V )=[2G{M l + M i )/\V\*]. (566) 

Otherwise the two stars should be strictly re¬ 
garded as the components of a binary system and 
this is inconsistent with our original premises. 
This restriction therefore leads us to infer that 
departures from true randomness exist for 
r~r(|F|). However, under the conditions we 
normally encounter in stellar systems, r(| V\) is 
very small compared to the average distance 
between the stars. Thus, in our galaxy, in the 
general neighborhood of thesun,r(| F|)-^2X10- 5 
parsec, and this is to be compared with an 
average distance between the stars of about 
three parsecs. Accordingly, we may expect the 
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Holtsmark distribution to be very close to the 
true distribution, except for the very highest 
values of | F|. More particularly, the deviations 
from the Holtsmark distribution are to be 
expected for field strengths of the order of 

|F|-(GA/ 2 /[r(|K|)]*) 

-w*[<l V\*)*¥/IG{M X + M t )'). (567) 
When | F | becomes much larger than the quan¬ 


tity on the right-hand side of Eq. (567), the true 
frequencies of occurrence will very rapidly tend 
to zero as compared to what would be expected 
on the Holtsmark distribution, namely (560). 
A rigorous treatment of these deviations from 
the distribution (555) will require a reconsidera¬ 
tion of the whole problem in phase space and is 
beyond the scope of the present investigation. 


3. The Speed of Fluctuations in F 

As we have already remarked the speed of fluctuations can be specified in terms of the distribu¬ 
tion function W(F,f) which gives the simultaneous probability of a given field strength F and an 
associated rate of change of F of amount / [cf. Eqs. (517) and (519)]. The general expression for this 
probability distribution can be readily written down using Markoff’s method [T, $3, Eqs. (51). (52). 
and (53)]. We have £cf. Eqs. (529) and (530)] 


where 


/)— f f exp [ — t(p»F + a »/)jA (p, <r)dgdo, 

647T 6 •'|p|_0*'|a|-0 

A(g, a) = limit \ —— f f f exp p(p**+«r ^ydrdVdlA 

«-*» L 4 ttK j \t\<rJ\ v\<» J 


(568) 


4r*»n/3 


(569) 


In Eqs. (568) and (569) p and or are two auxiliary vectors, n denotes the number of stars per unit 
volume, and 


4 = GM -; ^ = GM 


P'urther, 


V r(r»V) 
— 3- 


rdVdM— r(V ; M)dVdM 


(570) 


(571) 


gives the probability that a star with a relative velocity in the range ( V , V-\-dV) and with a mass 
between M and M-\-dM will be found. It should also be noted that in writing down Eqs. (568) and 
(569) we have supposed (as in §2) that the fluctuations in the local stellar distribution which occur 
are subject only to the restriction of a constant average density. 

Since 

- f f f rdrdVdM= 1, (572) 

4tt.R 3 

we can rewrite (569) as 


|r|<** / |K|<» 


A (p, a) = limit 


/?-♦* 


1 - 


4t rR 3 


f f f {1 — exp [i(g»4+a»'ii)~\\TdrdVdM 
r|<U*'| K|<» 


irR'nli 


(573) 


The integral over r which occurs in Eq. (573) is seen to be conditionally convergent when extended 
over all |r|, i.e., also for |r|—*«. Hence, we can write 


A (p, a) = limit 


1 - 


4t rR 3 


f f f 11 —exp •»{;)]} rdrdVdM ) 

•'.v—o*'! r|-o*'| V|-o j 


4rR*nl3 


or 


A(g, a) = exp [ —«C(p, a)] 


(574) 


(575) 
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where 


C{g, a) = I'LL 11 — exp } rdrdVdM. 


(576) 


This formally solves the problem. It does not, however, appear that the integral representing 
C(p, <r) can be evaluated explicitly in terms of any known functions. But if we are interested only 
in the moments of / for a given F and of F for a given / we need only the behavior of A(o, <r)and, 
therefore, also of C(g, a) for |a|, respectively, j p| tending to zero. For, considering the first and the 
second moments of the components /{./,, and f ( of /along three directions £, v, and f at right angles 
to each other, we have 


and 


HW</„>* = f W{F, f)Uf ( M =*. r). 

•'l/l-O 

w)(/«/.) a.= f w(f, f)U4f (m, t, v, r). 

‘'l/l-O 


(577) 


(578) 


where IF(F) denotes the distribution of F for which we have already obtained an explicit formula in 
§2. Substituting now for W( F, f) from Eq. (568) in the foregoing formulae for the moments we obtain 


and 


W(F)(J „).*»— f f f exp [ — i((fF+<r»/)]A(p, o)f,d9d<rdf, 

64 Jr « / i/;-o*'ipi-o*Vi-o 


(579) 




But 


t ; r r f 


6471-- i/i-o* 7 ipi-o^iai-o 


exp [— ffp’F + a •/)].•! (p, o)fJJododf. 


(580) 


1 

— I exp (-to •f)f t df= t$'(a t )6(<r,)5(<r f ), 
8 t 


-f 

8 ir 3 J, 


exp (-«r/)M— 


i/i—o 

CO 


(581) 


— f exp 

8t 3 ''i/i-o , 

etc. In Eq. (581) 5 denotes Dirac’s 5-function and 8' and 8" its first and second derivatives; and 
membering also that 


re- 


/ + ® /»+* 

f(x)8(x)dx = f( 0); I f( x ) 5 '( x)dx= _/'(0); J f(x)8"(x)dx = f " 


( 0 ). 


(582) 


Eqs. (579) and (580) for the moments reduce to 


and 


^ / (^)(/m)*»— r exp ( — ip*/?)!'—/l(p, a)l dp, 

8,r •'lpl-0 _l|(7|_o 

W{F)(f,J.) h = f exp (-!>./•)[— —X( P , <t)1 dp. 

8tt •'ipi-o Ld<r„d<r, J|<ri_o 


(§83) 


(584) 


We accordingly see that the first and the second moments of / can be evaluated from a senes 
expansion of A(q, a) or of C(p, a) which is correct up to the second order in |a|. Such a series expan- 
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sion has been found by Chandrasekhar and von Neumann and, quoting their final result, we have 
4 2 

C( e , <r)=— {2*)'GKM')to\Q\'+-TnG(o l {MV x ) k ,+<T 2 {M V 2 )»-2a i (MV i ) k .) 

15 3 

3 

H "T; (27r),C;i lpl _ ^( 5(7 i 2 + 4(7 2 2 -2(r3 2 )<,\/*F 1 %H-(4(r 1 2 + 5 £ r 2 2 -2a3 2 )(A/*k r 2 % 

28 


+ (40-3= - la C- - 2,7,’) (A/t JV>* - 8<r ! a 3 ( J l/t K, F,>„ - V, V ,)* 

+ 2,r lff! (MtF 1 F 2 > to ]+0(|<r| > ) (|<r|->0), (585) 

where ( )*, indicates that the corresponding quantity has been averaged with the weight function 
t(V\ M) [cf. Eq. (571)3; further, in Eq. (585) (ori, cr 2 , a$) and (Vi, V 2 , F 3 ) are the components of <r 
and V in a system of coordinates in which the z axis is in the direction of p. 

In Eq. (585) V= ( V\, V 2 , E 3 ) is of course the velocity of a field star relative to the one under con¬ 
sideration. If we now let u and v denote the velocities of the field star and the star under considera¬ 
tion in an appropriately chosen local standard of rest, then 


V=u-v. (586) 

In their further discussion, Chandrasekhar and von Neumann introduce the assumption that the 
distribution of the velocities u among the stars is spherical, i.e., the distribution function 'l'(ii) has 
the form 

^^(/WM 2 ), (587) 

where ^ is an arbitrary function of the argument specified and the parameter j (of the dimensions of 
[velocity3 _1 ) can be a function of the mass of the star. This assumption for the distribution of the 
peculiar velocities u implies that the probability function t(K; M) must be expressible as 


r(K; M) = *[j'(M)\u\^x(M), (588) 

where x(M) governs the distribution over the different masses. For a function r of this form we 
clearly have 


(MV^= <Af* W) A ,= h(M*\u\%+(M%v> (*= 1. 2, 3), 

(M* Vi V ,)*, = (», j = 1,2,3, tV j). 


(589) 


Substituting these values in Eq. (577) we find after some minor reductions that 

4 2 1 

C(p, a) = —(2tt) M% [ p |» iriG{M)^a +a 2 v t - 2<r,i/,) +-(2ir ) |u|%|p | +<r**) 

15 3 4 

3 

+—(27r)»C»(Af%|9|-J[a 1 2 (5v 1 2 -f4t; 2 2 -2t;, 2 )+<T2 2 (5p, 2 +4t; 1 2 -2t;, 2 ) 

28 

+ <7- 3 2 (4y 3 2 — 2i/i 2 — 2t;* 2 ) -f-2o-i<r 2 Vii/ 2 — 8a 2 a 3 v 2 v 3 — 8a 3 aiV 3 ViJ + 0( | a| *). (590) 

• 

With a series expansion of this form we can, as we have already remarked, evaluate all the first and 
the second moments of / for a given F. 

Considering first the moment of /, Chandrasekhar and von Neumann find that 



2 /\ F \\/ vF \ 


(591) 
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where Qh is the “normal field’’ introduced in §2 [Eqs. (550) and (551)] and 


B(0) 


■<I. 


mew j 0iJip)\- 1 . 


(592) 


We shall examine certain formal consequences of Eq. (592). 
Multiplying Eq. (591) scalarly with F we obtain 


but 


Hence, 


( 


/dF\ 4 ,\F\\ 

(_) =-xG(4/)*.n3(-) ( v *f); 

\ dt / f.v 3 V Q„ / 

(593) 

*■(") . 

V dt / F.v \ dt / F.v 

(594) 

d\F\ \ 4 /| F\\vF 

dt /f.v 3 \ Q„J \F | 

(595) 


On the other hand, if F j denotes the component of F in an arbitrary direction at right angles at the 
direction of v then according to Eq. (591) 



F, v 


/ \ F \vF 

2irG(M)*nB\ -)- F, 

V qJ\f\' 


Combining Eqs. (595) and (596) we have 

_L 71 Za _ 3 i 

F,\ dt ) f.v 2 |F| \ dt )F.v 


Equation (597) is clearly equivalent to 


(596) 


(597) 


We have thus proved that 


d 

—(log Fj- \ log | F | )f, v = 0. 
dt 


= 0 . 
V 



(598) 


(599) 


We shall now examine the physical consequences of Eq. (591) more closely. In words, (he meaning 
of this equation is that the component of 


2 / 1 ^ I \ / V'F \ 

- r c<j#) fc -B(—)(»-3— r) (600) 

along any particular direction gives the average value of the rate of change of F that is to be expected 
in the specified direction when the star is moving with a velocity v. Stated in this manner we at 
once see the essential difference in the stochastic variations of F with time in the two cases lyl = 0 
and \v\*0. In the former case <F>*.s0; but this is not generally true when |v| ^0. Or expressed 
differently, when M =0 the changes in F occur with equal probability in all directions while this is 
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not the case when \v \ ^0. The true nature of this difference is brought out very clearly when we 
consider 



(601) 


according to Eq. (595). Remembering that B(i 3)^0 for/9^0, we conclude from Eq. (595) that 


and 


(d\F\\ 


( ) >0 if (wF)> 0, 

V dt / F,v 

(602) 

/d\F\\ 


( —) <0 if (v-F)<0. 

V dt / F, v 

(603) 


r n other words, if F has a positive component in the direction of v, | F | increases on the average, 

while if F has a negative component in the direction of v, | FI decreases on the average. This essential 

asymmetry introduced by the direction of v may be expected to give rise to the phenomenon of 
dynamical friction. 

Considering next the second moments of f Chandrasekhar and von Neumann find that 
< I /I V. »>*, = 2 ab—~ {2 G(0) + 7 k[_G(0) sin 2 a - 1(0) (3 sin 2 a - 2)] } 


+77777I (4 - 3 sin 2 a) + 3 K(0) (3 sin 2 a - 2) ), (604) 

pH (0) 

where, a denotes the angle between the directions of F and v 


a = 


and 


—(2*-)«G»(M%n; 6 = -(2 t)*G’*(A/* | u | 2 )*,«, g = ^KG(M)*,\ v\n; k = - (605) 

15 4 3 7 (Af*|ii| 2 )/w 


2 r 

H(0 )=— | exp [— (x/0)'~\0 sin 0d0, 

TT0 J 0 


3 r° r o 

G ^)=~ J o 0-'H(0)d0, I(0) =0-1J 0lG(0)d0, K(0) = J H(0)d0. 


^ (606) 


Averaging Eq. (604) for all possible mutual orientations of the two vectors F and v we readily find 
that 


«!/|V. M»A, = 4a6 


0'G(0) / 


im 




+ 


ill 


2 ab) 


(607) 


or, substituting for k and g*/2ab from (605) we find 


l // ( 0 ) 


(M*\ 




(M)*' |tf|* 


12t(3/%(A/*|u|%J 


(608) 


In terms of Eq. (608) we can define an approximate formula for the mean life of the state F ac¬ 
cording to the equation 

r|F|.N=|F|/(((|/|V» A .)». (609) 
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Combining Eqs. (608) and (609) we find that 


T\f\, k|= TVi.o- 


1 


r 5 <i\/)*, 5 i i/| J im i» 

1 -|-1-I 

l \2n (Xf')>,{M'\u ')a.I3'G{0) J 


where T\F\. o denotes the mean life when |rj = 0: 


T\f 


• 0= [ 


a' fH//(tf)->* 

46 G(/3) J 


Erorn Eq. (610) we derive that 


T«\F as F |—0; r<x|/r|-» 


as 


OC 


(610) 


(611) 


612) 


in other words the mean life tends to zero for both weak and strong fields. 

1 am greatly indebted to Mrs. T. Belland for her assistance in preparing the manuscript for the 
press. My thanks are also due to Dr. L. R. Henrich for his careful revision of the entire manuscript. 

APPENDIXES 

I. THE MEAN AND THE MEAN SQUARE DEVIATION OF A BERNOULLI DISTRIBUTION 
( onsider the Bernoulli distribution 


u'(x) = 


n ! 


x\(n—x )! 


p x (l—p) n 1 (p < 1 ; x a positive integer ^ n). 


(613) 


An alternative form for w(x) is 

w(x) = C, n p x q 

where C z n denotes the binomial coefficient and 


n —r 


(614) 


5=l-p. (615) 

Prom Eq. (614) it is apparent that iu(x) is the coefficient of u z in the expansion of (pu+q) n : 


w(x) = coefficient of u z in (pu + q ) n • 
That Ew x =l follows immediately from this remark: 

n n 

21 w(x) = Y. coefficient of u x in (pu + q) n , 


X-l 


x-1 


= [(P«+9)"]u-l=l. 

Consider now the mean and the mean square deviation of x. By definition 


(616) 


(617) 


and 


<*>* = 21 xw(x) 


(618) 


* = <(* - <*>*.)’>*. = Or 2 )*, - <*V = £ xhv(x) - (xW. 


(619) 
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We have 


Hen 


ce 


Similarly, 


or. 


(*)*» = £*X {coefficient of u x in {pu+q) n J, 

r—I 


= £ coefficient of u x in — (pu+q) 
z ~ l du 

= \_Tu PU+q)n \ 


(*)*, = np. 


(*%=£ * 2 X {coefficient of u z in ( pu+q ) n }, 


i-i 


" . d / d \ 

= £ coefficient of in —l u — [pu+qy ), 

du\ du /' 

= (—(“—Cf«+?]") I , 

li/wV du / J u _, 


= 1)^2 

Combining Eqs. (619), (621) and (623) we obtain 

<5 2 = np-n/> 2 = «p(l -p) = n p Q ' 


t (620) 


(621) 


* (622) 

(623) 

(624) 


II. A PROBLEM IN PROBABILITY: MULTIVARIATE GAUSSIAN DISTRIBUTIONS 

• In , CH u aP r \ ( ? 4, subsection M) we considered the special case of the problem of random flights 
in which the N displacements which the particle suffers are all governed by Gaussian distributions 
but with different variances. We shall now consider a generalization of this problem which has 

important applications to the theory of Brownian motion (see Chapter II, §2, lemma II). 

Let 


* s 

= * = £<*>>r, (625) 

i-i 

where the \J/j s and the <£, s are two arbitrary sets of N real numbers each, and where further r is a 
stochastic variable the probability distribution of which is governed by 

t( 0 = (l/(27r/ 5 ) 1 ) exp (— | r| V2/ 2 ). (626) 

where / is a constant. We require the probability W(W, ^d^d* that'F and 4> shall lie, respectively, 
in the ranges (*r,'F+</'F) and (<!>, O+rfO). Applying Markoff's method to this problem, we have 
[cf. Eqs. (51) and (52)3 

1 /»+“ /*+• 

4») = ——- I I exp Q — *(p•'¥’ + *• < *»)}4AT(p, o)dpd<r, (627) 

64x® •/_. J_ x 

where q and a are two auxiliary vectors and 


N 1 

a n (. 9 > o )=n 


7-1 (2x/*)» 



exp C*'(p-^ir+<r«0 y r)] exp (- |r| */2P)dr. 


(628) 
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To evaluate ,4,v(p, a) we need the value of the typical integral 


We have 


Hence 


1 

J— -I exp — ( I r i 2 /2/ 2 )]</r. 

(2W-*)« J - 


Jh {2xP)' J. 


exp | -[x' i + 2it 1 x{pd i +oi<t> } )~]/2P\dx, 


= exp ! — ^[(pl^; + <*l£;)' + (p3^>+^20»j 2 4- ip3'J',+ ai<t>f)' J 2}. 
/4v(p. a)=exp ! — l- YL [(Pt^'; + ^I 0 ;) ! +(p:'/'; + ‘ t 2 ‘/> 7 )‘+ (P3^7+a 3 <i>,) J ]. 2 | 


= exp [— (P\ p| 2 4-2/?o*(j4-Qia! 2 )/2] I 


where we have written 


V v ,v 

P=p£+f; ***£*,*,■; Q = l2 YL <*>?■ 

i -1 »-i 


(629; 


) (630) 


(631) 


(632) 


Substituting for A ,v(p. <r) from Eq. (632) in the formula for <P) [Eq. (627)] we obtain 


W( 


V, *)= — n f f exp |-[Pp l * + 2/fp l a. + ^a i ^ + 2i(Pi«'. + <r.4* l -)]/2|<fp i <f<r i . (633) 
64r s *-i J , -J 


+ * 


— X — X 


To evaluate the integrals occurring in the foregoing formula, we first perform a translation of the 
coordinate system according to 

P, = £. + a.; <y, = T?, + 0, (*=1,2,3), (634) 


where a, and 0, are so chosen that 

Fa, + /?jJ,a-i* l ; /?a,4-(?/9,= — »4>. (i=l,2, 3) 
With this transformation of the variables we have 

Ep, 2 + 2T?p,<7, +Qa* + 2i(p,\Iq + a,40 = -}- 27?£,t7, + () i7, 2 + i(a . 'I', -f 0/I\), 


(635) 


Hence, 


”P* t t +2Ri l r, t + Qi,?+ -(/>4>,’-2/tt>,*,4-W). 

PQ-R 1 


(636) 


1 3 


W'f'F, *) =-n exp [-(P4> l 2 -2/?4>,^,4-<2'I', 2 )/2(/ ? (2-/? 2 )] 

64?r 8 *-i 


+* 


x f f ex Pt-(W+ 2 -Rf.’>.+'3-i, 3 )/2]dW, ( 

From this equation we readily find that 

<l») = [l/87r i (P<2-/? 2 )»]exp [-(P\<Pl*-2Rw-<P + Ql V|*)/2(PQ-/?*)], 
which gives the required probability distribution. 


(637) 


(638) 


ID. THE POISSON DISTRIBUTION AS THE LAW OF DENSITY FLUCTUATIONS 

Consider an element of volume v which is a part of a larger volume V. Let there be N particles 
distributed in a random fashion inside the volume V. Under these conditions the probability that a 
particular particle will be found in the element of volume v is clearly v/V\ similarly, the probability 
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th .f, t j t ' viM not be found inside » is (V-v)/V. Hence, the probability W„(n) that some n particles 
will be found inside v is given by the Bernoulli distribution 


N\ / v \ n / v \ 

W s {n) = -(- ) ( i-) 

n\(N-n)\\V/ \ V) 


X-n 


(639) 


The average value of n is therefore given by [cf. Eq. (621)] 

(«)*, = N(vf V) = v (say). 

In terms of v Eq. (639) can be expressed in the form 


(640) 


ah / v \ n / v \ s ~ n 

W N {n) = -( —) ( 1-) . 

n\(N-n)\\N/ \ N/ 


(641) 


The case of greatest practical interest arises when both N and V tend to infinity but in such a way 

that v remains constant [see Eq. (640)]. To obtain the corresponding limiting form of the distribu¬ 
tion (641) we first rewrite it as 


Ws(n) = -N(N-l)(N-2).--(N-n + l)(-Y( 1--V ", 
n\ \N/ V N/ 


(642) 


and then let Af—» *> keeping both v and n fixed. We have 


W{n) = limit Ws(n), 

S-x> 


V n / V \ v 

= - limit ( 1-) . 

n\ \ N/ 


(643) 


Hence, 


W(ti) = v n e~ 9 /ti !, 


(644) 


which is the required Poisson distribution. 

In some applications of Eq. (644) (e.g., Ill, §3) v is a very large number; and when this is the case, 
interest is attached to only those values of n which are relatively close to v. We shall now show that 
under these conditions the Poisson distribution specializes still further to a Gaussian distribution. 
Rewriting Eq. (644) in the form 


log W(n ) = n log v—v— log n ! 

and adopting Stirling’s approximation for log n [cf. Eq. (7)] we obtain 

log W(n) = n log v — v — (n + §) log n + n — £ log 2* + 0(n _1 ). 


(645) 


Let 


Equation (646) becomes 


n — »/4-<5. 


log W{n)= — (v + 5-f $) log ( 1 + 




£ log (2 t v) + 0(n- x ). 


(646) 

(647) 


(648) 
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If we now suppose that $/*«l we can expand the logarithmic term in Eq. (648) as a power series in 
b/v. Retaining only the dominant term, we find 


Thus, 


log W(n)= log (2 tv) 0— « ; 5/v—0). 

W(n) = [ 1/(2tv)*] exp [ - (n - vY/2v~\ t 


(64 9) 
(650) 


which is the required Gaussian form. 

IV. THE MEAN AND THE MEAN SQUARE DEVIATION OF THE SUM OF TWO PROBABILITY DISTRIBUTIONS 

Let W\(x) and w j(y) represent two probability distributions, hor the sake of definiteness we shall 
suppose that x and y take on only discrete values. A probability distribution which is said to be 
the sum of the two distributions is defined by 

w{z) = wi(x)wj(y), (651) 

x + y—x 

where in the summation on the right-hand side we include all pairs of values of x and y (each in their 
respective domains) which satisfy the relation x + y = z. We may first verify that w(z) defined accord¬ 
ing to Eq. (651) does in fact represent a probability distribution. To see this we have only to show 
that £u>(z) = 1. Now, 

Z^(z) = E Z w'i(x)u> 2 (y); (652) 

i t i+y-i 

accordingly, in the summation on the right-hand side, x and y can now run through their respective 
ranges of values independently of each other. Hence, 

Z« w(z) = [I J u',(j:)][^ y a' 2 ()')]= 1. (653) 

We shall now prove that the mean and the mean square deviation of the sum of two probability dis¬ 
tributions is the sum of the means and the mean square deviations of the component distributions. 

To prove this theorem, we observe that by definitions 

(z)a. = Z z^(z) = E Z (x+y)wx(x)w2{y), (654) 

x x z-ryr—i 

or 

(z)* = Z* Ev [.xvJx(x)-Wi{y)+yw x (x)w i (y)'], (655) 


where in the summations on the right-hand side we can again let x and y run their respective ranges 
of values independently of each other. Hence, 


<z)* = [Z* *wi(*)][Ev ^Wl+CZxWiWIE^FiW]. (656) 

or 

<z>a, = <*>* +OV (657) 

Similarly, 

((z~-(z)*)% = Z, (* — (*)*)*»(*), 

= E Z (*+y—<*)*—(y)*i) a “ , i(*) w *(y)* 

x t 

= E* Zv [(x—(x)*,)*-f 2(x—(x)*.)0 — 0)*)+0 — (y)*)*D w i(*)wiO)» 

= [Z* (*-(*>*)W*)][Ev^iO)]+[Z*u'i(*)][E,, 0-0 >*)^j0)] 

+ 2 CE« (x-(x) fa )u»i(x)][E, 0-0 >*)wj0)].j 


> 


(658) 
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(659) 


((z (z) A,) 2 )* - ((x- (*)*)% + ((>- — (jy) A ,)2) Af . 

The theorem is now proved. 

The extension of the foregoing results to include the case when * and y are continuously variable is 

ntor^^p^lK^^r and rCSUltS Ca " ^ fUrtHer inC ' Ude the — * 


V. ZERMELO'S PROOF OF POINCARg’S THEOREM CONCERNING THE QDASI-PERIODIC CHARACTER 

OF THE MOTIONS OF A CONSERVATIVE DYNAMICAL SYSTEM CHARACTBR 

Consider a conservative dynamical system of n degrees of freedom and which is described bv a 

s“at n eof°s n uch T™ " °' and moment “ Th 

e u sand i's S fX7 IT™ T ^ 3 ^ j " the 2 * d ™-sionaT phas^ space of 

tionVf the d y na“ lystem aJe 0ry deSCnbCd b> ' ““ point will describe the evolu- 

the T ca r :onL7 C e h q uTtioni7 molr ^ ' herC “ 3 * hich ™ * drived 


dH 


?.= 


dll 


P.= - 


(5—1, *••,«). 


(660) 


dp* dq, 

phase 777"; r SidC ; <lny ' lr !’ itrary “"tinuous domain of points (of finite measure) in the 
phase space Let the points go be the representatives at time 1 = 0 of an ensemble of dynamical systems 
all described by the same Hamiltonian function H(p u •.p m - Ql ... o) a t , Z 

by tracing throulh e; h r 7 °7 UPy 3 con,inuous domain of points g, which can be obtained 
, y . . K 7 gh each point of g 0 the corresponding trajectory and following along the various 

g ven point ,'n 7 *’ * 7 the U " iqUeness ' in general, of the trajectories passing through a 

k en point in the phase space, the construction of the domain g, from an initial domain e* is a 

(at *t im e*/ —0)*oft'h 'h' 1 " a “° rdin ? ly , refer to *• as ^future phase (at time I) of the initial phase go 

SDa^™^" 8 \° L 7 UVi " e ' S the ° rem ° f classical dynamics, the density of any element of phase 
space remains constant during its motion according to the canonical Eqs. (660). Hence, if denotes 

rom V Li U ouvine*7h° n u d ° main ° f P ° intS g ‘ introduced in the preceding paragraph, it follows 
irom Liouville s theorem that co, remains constant as t varies. 

YY’e have already described how from an initial phase g 0 we can derive the future phase g, at time t. 

The domain of points g 0 together with all its future phases (0</< ») clearly form a continuous 

domain of points which we shall denote by F 0 : T 0 is accordingly the class of all states which at some 

finite past occupied states belonging to g 0 . The extension of T 0 will be finite if we are considering a 

dynamical system which is enclosed—for, then, none of the coordinates or momenta can take on 

infinite values and the entire accessible region of the phase space remains finite. We shall suppose 

that this is the case and denote by the extension of r 0 . Clearly « 0 . In a similar manner we can. 

quite generally, define the domain of points T« which includes all the future phases of g t . Let denote 
the extension of rIt is evident that 

whenever t\<h. (661) 

For denoting the extension of all the future phases of g, t must therefore necessarily include also 
the future phases of g, t if t x <tj. On the other hand, considering T 0 itself as a domain of points, we 
can construct its future phases in exactly the same way as the future phases g, of g 0 were constructed. 
But the future phase of T 0 after a time / is clearly T,. And therefore applying Liouville’s theorem to 
the domain T 0 and its future phases T, we conclude that 


fl< = constant. 


(662) 



STOCHASTIC PROBLEMS IN PHYSICS AND ASTRONOMY 


85 


Comparing this result with the inequality (661) we infer that the domain of points F, can differ from I\> 
by at most a set of points of measure zero. Hence, the future phases of gt(t> 0 but arbitrary otherwise) 
must include go apart, possibly, from a set of points of measure zero. But the points of g, are them¬ 
selves future phases of the points of go- Hence, the states belonging to go (again, with the possible 
exception of a set of zero measure) must recur after the elapse of a sufficient length of time , and this 
is true no matter how small the extension ujo of go is, provided it is only finite. !• rom this, the deduc¬ 
tion of Poincare’s theorem is immediate. (For a formal statement of Poincare s theorem see Chapter 
HI, §4). 

VI. BOLTZMANN’S ESTIMATE OF THE PERIOD OF A POINCAR£ CYCLE 

To estimate the order of magnitude of the period of a Poincare cycle, Boltzmann has considered 
the following typical example: 

A cubic centimeter of air containing 10 18 molecules is considered in which all the molecules are 
initially supposed to have a speed of 500 meters per second. \\ ith a concentration of 10 ls molecules, 
the average distance between the neighboring ones is ot the order of 10 f cm. Also, under normal 
conditions, each molecule will suffer something like 4X HP collisions per second so that on the whole 
there will occur 

b = 2X10 27 collisions per second. (665) 

Since Poincare’s theorem asserts only the quasi-periodic character of the motions (see ( hapter III, 
§4 and Appendix V) the period to be estimated clearly depends on the closeness to which we require 
the initial conditions to recur. For the case under discussion Boltzmann supposes that a molecule 
can be said to have approximately returned to its initial state if the differences in position i.r, y, z) 
and velocity (u, v, w) in the initial and the final states are such that 


and 


Ax|, 1 Ay |, |Az| ^ 10 7 cm, 
Au |, At- i, I Aw.' |(l m sec. 


(664) 


(665) 


In other words, we shall require the positions to agree to within 10 percent of the average distance 
between the molecules and the velocities to agree within one part in 500. 

We shall first estimate the order of magnitude of the time required for the recurrence of an initial 
“abnormal” distribution in the velocities. According to Poincare’s theorem, an initial state need not 
recur earlier than the time necessary for all the molecules to take on all the possible values for the 
velocity. We can readily determine the number N of such possibilities with the understanding that 
we agree to distinguish between two velocities only if at least one of the components differ by more 
than 1 m/sec. 

The first molecule can have all velocities ranging from zero to a = 500x 10® m/sec.—since we have 
supposed that in the initial state all the molecules have the same speed of 500 m/sec and that there 
are 10 18 molecules in the system. Again, if the first molecule has a speed tq the second one can have 
speeds only in range 0 to (a 2 — tv)*. Similarly, if the first and the second molecules have speeds tq 
and v 2 , respectively, the third molecule can have speeds only in the range 0 to (a 2 — tq* —iq 2 )*; and so 
on. Accordingly, the required number of combinations N is 


where 


J « a r*{a x — Pi*)* —v i*— 

dvii’i 2 I dv 2 v 2 2 I dv 3 v 3 2 -- 

o ^ o ^ o 

= ( T «n-j,/ 2 / 2 .3-4- • [3(n-l)/2])a J( — , > (n, odd), 

= (2(2 *)<*'-*>'*/$ -5 • 7 • • -3(w - l))a 3( "-'> (n, even), 


l 


( a i — r»* • • • — 


dv n -!»*»_!, 


> ( 666 ) 


a = 500X10® and w = 10' 8 . 


(667) 
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Since each of these N combinations occurs on the average in a time 1 /b seconds [cf. Eq. (663)] the 
total time required for the velocities to run through all the possible values is 

N/b. (668) 

After this length of time we may expect the initial distribution of the velocities to recur to within the 
limits of accuracy specified except for one single molecule the direction of whose motion has been 
left unrestricted. On the other hand we have still left unspecified the positions of the centers of gravity 
of all the molecules. But in order that we may say that the initial state has recurred to a sufficient 
approximation, we must require the positions of the molecules in the final state also to agree with the 
initial values to some stated degree of accuracy. This would clearly require the time (668) to be 
multiplied by another number of order similar to N. However, the extremely large value already' of 
N b gives some indication of the enormous times which are involved Moreover, comparing these 
times with the time of relaxation of a gas which is of the order 10 -8 second under normal conditions, 
we get an idea as to how extremely small the fraction of the total number of complexions is for which 
appreciable departures from a Maxwellian distribution occur. (For a further discussion of these and 
related matters see Chapter III, §4.) 

VII. THE LAW OF DISTRIBUTION OF THE NEAREST NEIGHBOR IN A RANDOM 

DISTRIBUTION OF PARTICLES 

This problem was first considered by Hertz (see reference 71 in the Bibliographical Notes for 
Chapter IV). 

Let w(r)dr denote the probability that the nearest neighbor to a particle occurs between r and 
r-\-dr. This probability must be clearly equal to the probability that no particles exist interior to r 
times the probability that a particle does exist in the spherical shell between r and r-\-dr. Accordingly, 
the function u'(r) must satisfy the relation 



1 — f w(r)dr 4 irr-n, 
J 0 


(669) 


where n denotes the average number of particles per unit volume. From Eq. (669) we derive: 


Hence 

since, according to Eq. (669) 


d f u-(r) I w(r) 

—-= — Airr^n -. 

drVAirr^nA Airr^n 

U'(r)=exp ( — 4irr 3 n/3)4irr 2 n, 


iv(r)—>4irr 2 n as r—»0. 


(670) 

(671) 

(672) 


Equation (671) gives then the required law of distribution of the nearest neighbor. 

Using the distribution (671) we can derive an exact formula for the “average distance” D between 
the particles. For, by definition 


or, if we use Eq. (671) 



D= (* exp ( — 4rr , n/3)4rr 3 ndr. 

•'n 


(673) 

(674) 
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After some elementary reductions, Eq. (674) becomes 


Substituting for 174. 3), we find 


1 r x 

£)- -I e' z x l dx, 

(4 xti 3)* 

= 1(4 3)/(4tw 3)«. 


D — 0.5 5366« 1 



(675) 


(676) 


BIBLIOGRAPHICAL NOTES 


Chapter I 

§/.—We may briefly record here the history of the 
problem of random flights considered in this chapter: 

Karl Pearson appears to have been the first to explicitly 
formulate a problem of this general type: 

1. K. Pearson, Nature 77, 294 (1905). Pearson s for¬ 
mulation of the problem was in the following terms: "A 
man starts from a point O and walks / yards in a straight 
line; he then turns through any angle whatever and walks 
another / yards in a second straight line. He repeats this 
process n times. I require the probability that after these 
n stretches he is at a distance between r and r + dr from 
his starting point 0.” After Pearson had formulated this 
problem Lord Rayleigh pointed out that the problem is 
formally "the same as that of the composition of n iso- 
l>eriodic vibrations of unit amplitude and of phases 
distributed at random” which he had considered as early 
as in 1880: 

2. Lord Rayleigh, Phil. Mag. 10, 73 (1880); see also 
ibid. 47, 246 (1889). These papers are reprinted in Scientific 
Papers of Lord Rayleigh , Vol. 1, p. 491, and Vol. IV. p. 370. 
In the foregoing papers Rayleigh obtains the asymptotic 
form of the solution as n—«. But for finite values of n 
the general solution of Pearson s problem was given by 

3. J. C. Kluyver, Konink. Akad. Wetenschap. Amster¬ 
dam 14, 325 f 1905). The general solution of the problem 
of random walk in one dimension was obtained by Smo- 
luchowski apparently independently of the earlier inves¬ 
tigators. 

4. M. von Smoluchowski, Bull. Acad. Cracovic, p. 203 
(1906). In its most general form the problem of random 
flights was formulated by A. A. Markoff who also outlined 
the method for obtaining the general solution. 

5. A. A. Markoff, Wahrscheinlichkeilsrechnung (Leipzig, 
1912), §§16 and 33. 

5^* T he problem of the random walk with reflecting 
and absorbing barriers was first considered by Smo¬ 
luchowski: 

6. M. v. Smoluchowski, (a) Wien Ber. 124. 263 (1915); 
also (b) Drei \ortrage uber Diffusion, Brownsche Be- 
wegung und Koagulation von Kolloidteilchen,” Physik. 
Zeits. 17, 557, 585 (1916). See also 

7. R. von Mises, Wahrscheinlichkeilsrechnung (Leipzig 
and Wien), pp. 479-518. 


§J.— Markoff s method described in this section is a 
somewhat generalized version of what is given in Markoff 
(reference 5). See also 

8. M. von Laue. Ann. <1. Physik 47, 85 f (1915). 

§4.—See A. A. Markoff (reference 5). The case of finite 
.V considered in subsection <b) follows the treatment of 

9. Lord Rayleigh. Phil. Mag. 37. 321 (1919) (or Scien¬ 
tific Papers . Vol. VI, p. 604). 

§5.—The passage to a differential equation for the case 
of the one-dimensional problem of the random walk was 
achieved by Rayleigh: 

10 Lord Rayleigh. Phil. Mag. 47. 246 (1899) for Scien¬ 
tific Papers , Vol. IV, p. 170). See also Smoluchowski 
(reference 6). But the general treatment given in this 
section appears to be new. 

We may also note the following further reference: 

11. W. H. McCrea, Proc. Roy. Soc. Edinburgh 60, 281 
(1939). 

Chapter II 

1 he following general references may be noted. 

12. T he Svedberg, Die Exislenz der Molekule (Leipzig, 
1912). 

13. G. L. de Haas-Lorentz, Die Brownsche-Bewegung und 
einige verwandte Erscheinungen, (Braunschweig, 1913). 

14. M. v. Smoluchowski, see reference 6(b). 

15. J. Perrin, Atoms (Constable, London. 1916). 

16. R. Flirth, Schwankungserscheinungen in der Physik 
(Sammlung Vieweg, Braunschweig, 1920), Vol. 48. 

§/.—As is well known the modern theory of Brownian 
motion was initiated by Einstein and Smoluchowski: 

17. A. Einstein, Ann. d. Physik 17, 549 (1905); also, 
ibid. 19. 371 (1906). 

18. M. v. Smoluchowski, Ann. d. Physik 21, 756 (1906). 
In Einstein's and in Smoluchowski's treatment of the 
problem, Brownian motion is idealized as a problem in 
random flights; but as we have seen, this idealization is 
valid only when we ignore effects which occur in time 
intervals of order 0 *. For the general treatment of the 
problem we require to base our discussion on an equation 
of the type first introduced by Langevin: 

19. P. Langevin, Comptes rendus 146, 530 (1908). In 
this connection see 
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20. F. Zernike, Handbuch der Physik (Berlin, 1928), 
Yol. 3, p. 456. 

§2.—The treatment of the Brownian motion of a free 
particle given in this section is derived from: 

21. L. S. Ornstein and \Y. R. van Wijk, Physica 1, 235 
(1933). See also 

22. W. R. van Wijk, Physica 3, 1111 (1936). Earlier, 
but somewhat less general treatment along the same lines 
is contained in 

23. G. E. Uhlenbeck and L. S. Ornstein, Phys. Rev. 36, 
823 (1930). In the foregoing papers the discussion has been 
carried out only for the case of one-dimensional motion. 
In the text we have treated the general three-dimensional 
problem; further, the arguments in references 21 and 22 
have been rearranged considerably to make the presenta¬ 
tion more direct and straightforward. 

§J.—See Ornstein and Wijk (reference 21); also 

24. G. E. Uhlenbeck and S. Goudsmidt, Phys. Rev. 34, 
145 (1929). 

25. G. A. van Lear and G. E. Uhlenbeck, Phys. Rev. 38, 
1583 (1931). 

§4.—The passage to a differential equation for the de¬ 
scription of the Brownian motion of a free particle in the 
velocity space was achieved by 

26. A. D. Fokker, Ann. d. Physik 43, 812 (1914). A more 
general discussion of this problem is due to 

27. M. Planck, Sitz. dcr preuss. Akad. p. 324 (1917). 
See also references 21 and ^3; further, 

28. Lord Rayleigh, Scientific Papers, Vol. Ill, P- 473. 

29. L. S. Ornstein, Versl. Acad. Amst. 26, 1005 (1917); 
also Konink. Akad. Wetenschap. Amsterdam 20, 96 (1917). 

30. H. C. Burger, Versl. Acad. Amst. 25, 1482 (1917). 

31. L. S. Ornstein and H. C. Burger, Versl. Acad. Amst. 
27, 1146 (1919); 28. 183 (1919); also Konink. Akad. 
Wetenschap. Amsterdam 21, 922 (1918). 

Earlier attempts to generalize Liouville’s equation of 
classical dynamics to include Brownian motion are con¬ 
tained in 

32. O. Klein, Arkiv for Matcmatik, Astronomi, och 
Fysik 16, No. 5 (1921); and 

33. H. A. Kramers, Physica 7, 284 (1940). 

The passage to a differential equation in configuration 
space was first achieved by 

34. M. v. Smoluchowski, Ann. d. Physik 48, 1103 (1915); 
see also, 

35. R. Ftirth, Ann. d. Physik 53, 177 (1917). 

In the text the discussion of the various differential 
equations has been carried out more generally and more 
completely than in the references given above; this is 
particularly true of the discussion relating to the generaliza¬ 
tion of the Liouville equation of classical dynamics (sub¬ 
sections, ii-v). 

§5.—See H. A. Kramers (reference 33). 

Approaches to the problem of the Brownian motion 
somewhat different to the one we have adopted are con¬ 
tained in 

36. G. Krutkov, Physik. Zeits. der Sowjetunion 5, 287 
(1934). See also the various articles by the same author in 
C. R. Acad. Sci. USSR during the years (1934) and (1935). 


37. S. Bernstein, C. R. Acad. Sci. USSR, p. 1 (1934), 
and p. 361 (1934). A more particularly mathematical dis¬ 
cussion of the problems of Brownian motion has been 
given by 

38. J. L. Doob, Ann. Math. 43, 351 (1942); see also the 
references given in this paper. 

Chapter III 

The following general references may be noted. 

39. M. v. Smoluchowski, reference 6(b). 

40. A. Sommerfeld, “Zum Andenkcn an Marian von 
Smoluchowski,” Physik. Zeits. 18, 533 (1917). 

41. R. Fiirth. Physik. Zeits. 20, 303, 332, 350, 375 (1919); 
also reference 16. 

42. H. Freundlich, Kapillarchemie (Leipzig, 1930-1932), 
Vols. I and II; see particularly pp. 485-510 in Vol. I and 
pp. 140-162 in Vol. II. 

43. The Svedberg, Die Existenz der Molekule (Leipzig, 
1912). 

In reference 39 we have an extremely valuable account 
of the entire subject of Brownian motion and molecular 
fluctuations; there exists no better introduction to this 
subject than these lectures of Smoluchowski. In reference 
40 Sommerfeld gives a fairly extensive bibliography of 
Smoluchowski’s writings. 

§/.—The theory of density fluctuations as developed by 
Smoluchowski represents one of the most outstanding 
achievements in molecular physics. Not only does it 
quantitatively account for and clarify a wide range of 
physical and physico-chemical phenomena, it also intro¬ 
duces such fundamental notions as the “probability after¬ 
effect” which are of very great significance in other con¬ 
nections (see Chapter IV). 

44. M. v. Smoluchowski, Wien. Ber. 123, 2381 (1914); 
see also Physik. Zeits. 16, 321 (1915) and Kolloid Zeits. 
18, 48 (1916). For discussions of the problem of density 
fluctuations prior to the introduction of the notion of the 
“speed of fluctuations” see 

45. M. v. Smoluchowski, Boltzmann Festschrift (1904), 
p. 626; Bull. Acad. Cracovie, p. 1057, 1907; Ann. d. Physik 
25. 205 (1908). Also 

46. R. Lorenz and W. Eitel, Zeits. f. physik. Chcmie 87, 
293, 434 (1914). 

It is of some interest to recall that referring to his devi¬ 
ation of the formulae for (^„>a» and (A* 1 )** [Eqs. (356) and 
(358)3 Smoluchowski says, "Aus diesem komplizierten 
Formeln [referring to the formula for W(n; m)J lassen sich 
mittels verwickelter summationen merkwurdigerweise 
recht einfache resultate fur dicdurschschnittliche Andcrung 
der Teilchenzahl ableitcn. . . . So wie fur das Anderungs- 
quadrat bei unbestimmter Anfangszahl n [Eq. (363)3-" 
This led to some heated discussion whether these formulae 
cannot be derived more simply; for example, see 

47. L. S. Ornstein, Konink. Akad. Wetenschap. Am¬ 
sterdam 21, 92 (1917). But neither Ornstein nor Smo¬ 
luchowski seems to have noticed that the formulae for 
(A»)a» and (A„*)a» can be derived very directly from the 
fact that the transition probability W(n; m) is the sum 
(in a technical sense) of a Bernoulli and a Poisson dis- 
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tribution; it is to this fart that the simplirit> of the results 
.are due. 

§2.-—Comparisons between the predictions of his theory 
with the data of colloid statistics were first made by 
Smoluchowski himself (reference 44c 1 he e\j>crinients 

which were used for these first comparisons were those of 

48. The Svedbcrg, Zeits. f. physik. Chernie 77, 147 
(1911); see also references 43 and 46. But precision experi¬ 
ments carried nut w ith expressed intent inn of verifying 
Smoluchowski’s theory are those of 

49. A. Wcstgren, Arkiv lor Matematik. Astronomi, och 
Fvsik 11. Nos. 8 and 14 (1916) and 13, No. 14 (1918). 

An interesting application o! Smoluchow ski's theory to 
a problem of rather different sort has been made by Fiirth: 

50. R. Filrth, Physik. Zeits. 19. 421 (1918); 20. 1\ (1919). 
Fiirth made systematic counts of the number •>! pedes¬ 
trians in a block every live seconds. I hi? interval of five 
seconds was chosen because the length of the block was 
such that a pedestrian observed in the blot k on one 
occasion has an appreciable probability of remaining in the 
sime bhx:k when the next observation i> m ule li\e sec onds 
later. W e can, accordingly, define a probability after-effect 
factor P (=t T.a, where v is the average s|>ecd of a pedes¬ 
trian, r the chosen interval of time and a the length of the 
block), and Smoluchow ski’s theory applies. A statistical 
analysis of this data showed that the agreement with the 
theory is excellent. It is amusing that by s\stem.itic c ounts 
of the kind made by Fiirth it is possible actually to deter¬ 
mine the average speed of a pedestrian! 

§J.- - I he theory outlined in this section is derived from 

51. M. v. Smoluchowski, Wien. Her. 124. 339 (1915); 
see also references 39 and 41. 

§4 .—Among the early discussions on the compatibility 
between the notions of conventional thermodynamics and 
the then new standpoint of the kinetic molecular theory, 
we may refer to 

52. J. Loschmidt, Wien. Her. 73, 139 (1876); 75. 67 
(1877). 

53. L. Boltzmann, Wien. Her. 75, 62 (1877); 76. 373 
(1877); also Nature 51, 413 (1895) and Yorlesungen uber 
Cus 1 he or ie (Leipzig, 1895) Yol. I, p. 42 (or the reprinted 
edition of 1923). 

54. E. Zermelo, Ann. d. Physik 57, 485 (1896); 59 793 
(1896). 

55. L. Boltzmann, Ann. cl. Physik 57, 773 (1896)* 60 
392 (1897). 

Smoluchowski s fundamental discussions of tho limits of 
validity of the second law of thermodynamics are contained 
in 

56. M. v. Smoluchowski, Physik. Zeits. 13, 1069 (1912); 
14, 261 (1913). See also references 39 and 51. 

It is somewhat disappointing that the more recent dis¬ 
cussions of the laws of thermodynamics contain no relevant 
references to the investigations of Boltzmann and Smo¬ 
luchowski [e.g., P. W. Bridgman, The Nature of Thermo - 
dynamics (Harvard University Press, 1941)]. The absence 
of references, particularly to Smoluchowski, is to be 
deplored since no one has contributed so much as Smo¬ 
luchowski to a real clarification of the fundamental issues 
involved. 


For an exhaustive discussion of the foundations of sta¬ 
tistical mechanics, see 

57. P. and T. Ehrenfest, Pcgnffliche (Irundlagen der 
Statistic ken Auffassung in der Mechamk, Encyklofxidit der 
Mathematischen WHsenschaften (1911), Yol. 4, p. 4. And 
for Carath^odory’s version of thermodynamics see 

57a. S. Chandrasekhar. An Introduction to the Study of 
Stellar Structure < l nivtr>itv of Chicago Press, 19i0j f Chap. 

I. pp. I 1 -37. 

§5.—See Smoluchowski, reference 39; also 

58. M. v. Smolu< how ski, Ann. cl. Physik 4 8, 1103 (1915). 

59. R. Fiirth, Ann. d. Phy.-ik 53. 177 (191 7). 

§ 0 . - S-e Sniohn how-ki reference 39; also 

60. M v. SiuoIik how>ki, Zeits. f. phy>ik. ( hemic- 92, 1 29 
(1917;. 

61. R. Zsigmondy. /eit-. L physik. Chemie 92, 600 
(1917). 1 he papers 60 and 61 contain references to the 
earlier literature on the subject of coagulation. For the 
more recent literature >ee 1* mindin'h (reference 42, par¬ 
ticularly Yol. II, pp. 140-162). 

*7 —See 

62. II. \. Kramer-. I'h\>i< a 7. 284 '1940). Also, 

63. II. Pclzer and F.. Wigner, Zeits. f. [)hysik. Chemie, 
B15. 445 (1932). 

An aspect of tin* theory of Brownian motion we have 
not touched upon concerns the natural limit set by it to 
all measuring pnx esses. But an excellent review of this 
entire field exists: 

61. K. B. Barnes and S. Silverman, Rev. Mod. Phvs. 
6, 162 (1934). 

Chapter IV 

I he ideas developed in this chapter are in t he main taken 
from 

65. S. Chandrasekhar, Astrophys. J. 94, 511 (1941). 

66. S. Chandrasekhar and J. von Neumann, Astrophys. 

J. 95. 489 (1942). 

67. S. Chandrasekhar and J. von Neumann, Astrophys. 
J. 97. 1. (1943). 

§/.— Sec references 65, 66, and 67; also 

68. S. Chandrasekhar, Principles of Stellar Dynamics 
(University of Chicago Press, 1942), Chapters II and V. 

§Z.—The problem considered in this section is clearly 
equivalent to finding the probability of a given electric 
field strength at a point in a gas composed of simple ions. 
This latter problem was first considered by Holtsmark: 

69. J. Holtsmark, Ann. d. Physik 58, 577 (1919); also 
Physik. Zeits. 20, 162 (1919) and 25. 73 (1924). Among 
other papers on related subjects we may refer to 

70. R. Cans, Ann. d. Physik 66, 396 (1921). 

71. P. Hertz, Math. Ann. 67, 387 (1909). 

72. R. Cans, Physik. Zeits. 23, 109 (1922). 

73. C. V. Raman, Phil. Mag. 47, 671 (1924). 

§J— Sec references 66 and 67. See also three further 

papers on “Dynamical Friction" by Chandrasekhar in 

forthcoming issues of The Astrophysical Journal where 

further applications of the Fokker-Planck equation will be 
found. 
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Abstract 

\\ ith a method first indicated by Ornstein t he mean values ol all i he powers of i he 
velocity u and the displacement 50 I a free particle in Brownian motion are calculated. 

It is shown that u-u<,exp(-0/) and s-u o /0 |l-exp(-tf/)| where u 0 is the initial 
velocity and 0 the friction coefficient divided by the mass of the particle, follow 
the normal Gaussian distribution law. 1-or s this gives the exact frequency distribu¬ 
tion corresponding to the exact formula for j* of Ornstein and Furth. Discussion 
is given of the connection with the Fokker-Planck partial differential equation. 

By the same method exact expressions are obtained for the square of the deviation 
of a harmonically bound particle in Brownian motion as a function of the time and 
the initial deviation. Here the periodic, aperiodic and overdamped cases have to be 
treated separately. In the last case, when 0 is much larger than the frequency and for 
values ofthe formula takes the form of that previously given by Smoluchowski. 

I. General Assumptions and Summary 

TN THE theory of the Brownian motion the first concern has always been 
the calculation of the mean square value of the displacement of the par¬ 
ticle, because this could be immediately observed. As is well known, this 

problem was first solved by Einstein 1 in the case of a free particle. He ob¬ 
tained the famous formula: 


2kT 

s* = 2Dt = -/ 

f 


(1) 


where /is the friction coefficient, T the absolute temperature and t the time. 

e influence of the surrounding medium is characterized by / as well as 
by T. For this Einstein used the formula of Stokes, because almost always 
the particle is immersed in a liquid or gas at ordinary pressure. In that case 
t e mean free path of the molecules is small compared with the particle 
and we may consider the surrounding medium as continuous and may use 
he results hydrodynamics gives for the friction coefficient for bodies of 

Z P : T SP h ’ elU , PS ° id etC ) ' THiS Wi " d6pend 0n the viscos ‘ty coeffi¬ 
cient of the medium and therefore be independent of the pressure 

But of course, when the surrounding medium is a rarefied gas (mean free 

path of the molecules great in comparison with the particle), the friction 

™ r ; h he fur r-‘ des ° f Einstein 

ment”. Edited by R. Furth. translated by A. D. Cowper New Yor^ Dutm'r, CnC 
always refer. *onc, Dutton. To this we shall 
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will change in character. Instead of a Stokes friction, we then get what we 
may call a Doppler friction and this can also be calculated for simple forms 
of the particle. It is based on the fact that a particle moving, say to the right, 
w dl be hit by more molecules from the right than from the left. This fric¬ 
tion coefficient will be proportional to the pressure. To cover all cases, we 
will always leave the friction coefficient explicitly in the formulas. 

I he basis of formula (1), which since Einstein has been derived in various 
other ways, 2 has been almost always the equation of motion: 


du 


m — = 


dt 


= -fu + F(l) 


( 2 ) 


uheie u is the velocity of the particle. Characteristically of this equation, the 

influence of the surrounding medium is split into two parts: 

(1) a systematic part -///, which causes the friction 

(2) a fluctuating part F(t). Concerning this we will naturally make the fol¬ 
lowing assumptions: 

A: I he mean of F{t), at given /, over an ensemble of particles (a large 
number of similar, but independent particles), which have started at / = 0, 
with the same velocity u 0 , is zero. We will denote this by: 


F(lY° = 0. 


(3) 


B: There will be correlation between the values of F(t) at different times 

t\ and t 2 only when t,—t 2 is very small. More explicitly we shall suppose 
that: 


E(/i)F(/ 2 )" # = </>,(/, - / 2 ) (4) 

where 0 i(at) is a function with a very sharp maximum at x = 0. More gen¬ 
erally, when /], / 2 . . . . / n+1 are all lying very near each other, we assume: 

F(ti)F(t 2 ) • • • F(t n + 1) 0 = 0 n (r, 0 lf d 2 • • • 0„_i) (5) 

where r is the distance perpendicular to the line h =t 2 = ... . =/ n+1 in the 
(tt-bl) dimensional (/ lt t 2 ... . / n +i) space, and 6\, d 2 ... . d n -i are (n — 1) 
angles to determine the position of r in the subspace perpendicular to this 
line. The function 0 n has again a very sharp maximum for r = 0. Further, 
when ti t t 2 ... . t k are lying near each other, and also t k + 1 , /* +2 but 

far from the group h, t 2 . . . . t k and so on, then: 

PV7j~~T(u)T(t k+l ) ■ ■ • f(/,)F(77h) • • • f~(u)~~ " 0 

= Fit,) ■ ■ F(U) Uo ■ Flu +1 ) • • . Fl 7d U# • F(ti + i) • ■ •Flu' 9 • • • (6) 

The justification, or eventually the criticism, of these assumptions must 
come from a more precise, kinetic, theory. We will not go into that. 


Compare G. L. de Haas-Lorentz: Die Brownsche Bewegung (Braunschweig, Vieweg, 
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§3. In the later development, especially when given outside forces like 
gravitation were also considered, so that (2) had to he replaced by: 

du 

>n— = - fu + F(t) + K(x) (2a) 

at 

the attention was fixed more on the determination of the frequency distri¬ 
bution of quantities like the displacement or the velocity. Given the value 
0o of the quantity 0 at / = (), we wish to find the probability f(<t> 0 , 0, t)d<f> 
that after the time t the value lies between 0 and 0 d -d<f>. 1 1 is clear, that when 
we know F(0 O , 0,/) all mean values are determined. For instance: 



<p k F(<t> o, 0, t)d<f>. 


The frequency distribution is the most general thing the theory can predict. 
In the case of a free particle, the function F(x o, x, /), which will now depend 
only on x — xq = s, was already determined by Einstein. He found: 


/ i Y ' 2 

F(Xo,X,t) = [-) g-(x-r 0 ) 2 /4£>r 

\4irl)t / [l> 

°f which 0) is an immediate consequence. He derived this, by finding 

for F a partial differential equation, which in this case is the diffusion equa¬ 
tion: 


dz d-z 

dt ds 2 



and of which F(x x, t) is then the so-called fundamental solution. This is 
that solution of (8) which for /=0 becomes «(*-*„), when b(x) means the 
function, defined by the properties: 

<5(*) = 0 for x 4= 0 


/ + 

-00 


b{x)dx = 1 


This is clear from the definition of F(x„, x. t ) because for / = 0, there is cer¬ 
tainty that *Further there are boundary conditions, which express the 
behavior of the particle at the walls; in the case of a completely free par- 
t.c'e they are simply F = 0 for *= ± ». The relation between the diffusion 

coefficient D and the friction coefficient/, Einstein then derived very simply 
using the osmotic pressure idea. y y ' 

tial ^ etwe ^ n u the fre q^ncy distribution function and a par¬ 

tial differential equation of the parabolic type like (8), has later been gener- 

l.zed considerably by Smoluchowski, Fokker, Planck, Ornstein Burger 



826 


G. E. UHLENBECK AND L. S. ORNSTEIN 


I-urth and others. 3 The equation is generally called the Fokker-Planck 
equation. Especially for a particle under influence of outside forces, Smo- 
luchowski showed that the generalization of (8) was: 





d~z 

—(Kz) + D - 

dx dx~ 



!• or special forces (gravitation, elastic binding etc.) and by different boundary 
conditions, Smoluchowski, Fiirth and others have determined the funda¬ 
mental solution, and from this all sorts of mean values, which they have 
compared with experiments. 

§4. With the results (1), (7), (8) and (9) of Einstein and Smoluchowski 
the problem seems completely solved. But there is one restriction, which 
was first stressed by Einstein. All these results hold only when t is large 
compared to m f. The generalization of (1) for all times was given by Orn¬ 
stein 4 and Fiirth 5 , independently of each other. 

The result is: 



2mkT(f 

n w~~ 


1 4- 




values of t large compared to m f this becomes again Einstein’s formula 
I*or very short times on the other hand, we get: 


m 

as one would expect, because in the beginning the motion must be uniform. 

I he problem now arises to generalize the other results also. In part III 
we will do this for the frequency distribution F(x 0 , x, t ). The result is rather 
complicated; for /»;;; / it goes over into (7), and (10) is an immediate con¬ 
sequence of it. The method, we used, was the momentum method. From 
the equation of motion (2), and using the assumptions (3) to (6), we could 
calculate«the mean value of all the powers of 

mu o 

A = -(1 — £-/</»«)) 

f 

• 

3 M. v. Smoluchowski, Phys. Zeits. 17, 557 (1916). A. Fokk< r, Dissertation Leiden, 1913, 
p. 000. M. Planck, Berl. Her. p. 324, 1927. L. S. Ornstein, Versl. Acad. Amst. 26, 1005 (1917). 
H. C. Burger, \ersl. Acad. Amst; 25, 1482 (1917); L. S. Ornstein and H. C. Burger, Versl. 
Acad. Amst. 27, 1146 (1919); 28, 183 (1919). R. Furth, Ann. d. Physik 53, 177 (1917). R. 
hurth gives a survey in Riemann-Weber, Die Partiellen Differential-gleichungen der Math- 
ematischen Physik (Edited by R. v. Mises and Ph. Frank, Braunschweig Yieweg 1928) Vol. 
II, p. 177. Comp, also the article of F. Zernike, Handbuch der Physik, Yol. Ill, p. 456 (Ber¬ 
lin, Springer, 1928). 

4 L. S. Ornstein, Versl. Acad. Amst. 26, 1005 (1917) ( = Proc. Acad. Amst. 21, 96 (1919). 

5 R. Fiirth/Zeits. f. Physik 2, 244 (1920). 
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and prove that 5 follows the normal Gaussian distribution law. We did not 
succeed in generalizing the diffusion Eq. (8), and determining the distribu¬ 
tion function by this method. 

As a preparation we derive in part II the frequency distribution function 
G{u 0 , u, t ) for the velocity of a lree particle in Brownian motion, first with 
the momentum method, and then also with the Fokker-Planck equation. 

This extension to short times becomes especially interesting in the case 
ot outside periodic forces. In part IV we shall treat the problem of the 
Brownian motion of an elastically bound particle. By using the same method 
as before, we could get exact expressions for the mean square of the displace¬ 
ment as a function of the initial deviation and of the time. The periodic, 
aperiodic and overdamped cases have to be treated separately. The wav- 
in which the equipartition value is reached for/—»x is different in the three 
cases. In the last case, for very strong damping and !»m f the formula goes 
over into the result of Smoluchowski, which is a consequence of the frequency 
distribution function following from (9). 


II. The Frequency Distribution of the Velocity 

§5. I he problem is to determine the probability that a free particle in 
Brownian motion after the time / has a velocity which lies between // and 
u+du, when it started at / = 0 with the velocity u Q . 

_ The first method to solv e the problem is by calculating all the mean values 

u k for given u 0 . As has first been shown by Ornstein 6 for u and u\ this is 
possible by integrating the equation of motion: 


du 

- + = .1 (0 

when ft =//m and A =F/>u. Of course, the assumptions (3) to (6) hold for 

the fluctuating acceleration A(t), as well as for the fluctuating force F( t) 
Integrating we get: 


u = uoe-* 1 -f c~ 


** f e*h 
J 0 




( 11 ) 


Taking the mean over an ensemble of particles, which have started at 1 = 0 
with the same velocity u„, and using (3) we get: 


«“« = u Q e~ 0 ‘. 

The mean velocity goes down exponentially due to the fricti 
(11) and taking the mean, gives: 


( 12 ) 

ion. Squaring 


m 2 ° = uje-w 1 + 


U 0 J o 




6 L. S. Ornstein, Proc. Acad. Amst. 21, 96 (1919). 
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By taking £ + r?=i\ £-tj=w as new variables and by using (4), we can write 
for the integral: 

1 r 2t r +x r, 

—6* 2fl/ I I 4>\(w)dw = —(1 - e-2^0 

2 0 •'-ao 2/3 

because 0i(?c) is such a rapidly decreasing function, that we may integrate 
from — cc to -f- ac . The value of the constant 


Tl 


n +* 

= I 0i (w)d 


w 


we find with the help of the theorem of the equipartition of energy. For 
we must have: 




lim u 2 = 

I—* 2/3 




m 


so that: 


23 kT 


T 1 = 


W 


(13) 


Substituting, we get: 


U 2 = 


^ 7' 


m 


+ 


^MO 2 - 




;/i 


If 2 * 1 


(14) 


which shows, how the equipartition value is reached. So we can go on. Using 
the assumptions (3) to (6) for A(/) and the fact that we must get the equi¬ 
partition values for t —► sc, we wall prove in Note I, that for u — ttoexp( — /3/) 
the normal Gaussian distribution law' holds. For the velocity itself we get, 
therefore, the distribution law: 


G(u 0) u, t ) 


■(s 


m 


1 12 


kT( 1 - e-w«) 



m (u—noe -*) 2 


2 kT 


1-*-* J 


(15) 


which shows how the Maxwell distribution is reached, when at / = 0 all the 
particles started with the same velocity u 0 . 

§6. The second method for deriving (15) is, as we have already said, by 
constructing the Fokker-Planck partial differential equation for the problem, 
of which G(u o u, t) is then the fundamental solution. We will first derive the 
equation in general and then later specialize to our case. 7 Consider the dis¬ 
tribution function F(<f> 0 , 0, t). When t increases by At, 0 will increase by a 
A0, which will be different for every particle. Let the probability for an 
increase between the limits A0 and A0-M(A0) be 0(A0,0,/)cf(A0). Writing 
0'=0+A0 w r e have then: 


F(0o, 4>', t + At) = ^7* (0o, 0' — A0, /)0(A0, 0' — A0, t)d{A<t>) 


( 16 ) 


7 Comp. F. Zernike, Handbueh der Physik. Yol. Ill, p. 457. 
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w hen we may suppose that the probability of an increase A 0 is independent 

ot the fact that for / = 0 , <£=<£ 0 . We now develop the integrand after powers 
of A 0 : 

F(<t>o, <t>' - A0, /)0(A0, 0' - A0, t) = F(4>0 ', /)^(A0, 0', t) 

- A0C/- V + F*') + ~(F"+ + 2F'+' + Fi") + . . . 
The resulting integrals all have simple meanings, for instance: 

/ 0'> = 1; f A00rf(A0) = A0; f A0-0"<f(A0) = — A0- 

and so on. Developing the left hand side in powers of A/, putting : 


A<£ Ad> 2 

li m = 0; lim — = A(0', t) 

A / A/ _ 0 At 


( 17 ) 


and supposing that: 


A <t> k 

lim - = 0 - for k > 2 

a/-o A/ 


1H) 


we get, when we write again 0 for 0 ': 


OF 1 d-F 

= f 2 - \- 


dt 


2 a <*> 2 


_ f \0F 
\ d(t> / d(b 


a +{ ±!2-°L v . 

^0 V 2 (9</>~ 


(19) 


?: USt a° f C °r rse in each Special case determine the functions fd<t>,t) and 
IMd) and verify the supposition (18). We always can do that, when we 
know the equation of motion. 

Let us return now to the velocity distribution. From the equation of 
motion we have: 


u — « = Am = 


— (iuAt -F I A (£)i/£ 


fusing (3), we get therefore: 



Am = - puM = - p u 'At 
neglecting higher powers of At. From this: 


A M 

lim - = /,(«')- 0 „' 


At —o At 

In the same way, we find using ( 4 ) as before: 


so that: 


Am 2 = tiA l 



= const. 
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All the higher powers of An become proportional to powers of At higher than 
t he first, so that (\ 8 ) is satisfied. \\ e get therefore : 8 




d t i d G 

= V—UG) +- 

du 2 du 2 



I he systematic way of finding the fundamental solution of this equation 
is by solving the equation: 


dz d t j d 2 z 

— = f3—(uz) H- 

dt du 2 du 2 

wlien for / = 0, z=f(u). I his is an ordinary boundary value problem, which 
can easily be solved by the method of particular solutions. By summing 
the infinite series which we get, one can write the solution : 


z(u, t) 



♦ X 

f(ll 0 )G( U 0 Ut)dU 0 

>: 


and 6 is then clearly the fundamental solution. For the details, see Note II. 
I he result is again formula (15). One can derive the same result much more 
briefly when one is so clever as to substitute in (20) : 

G = (0) ,/2 exp{ — (u — Mox)tf>} 

where 0 and \ are functions of / only. 9 This is suggested a little by the result 
one ought to expect. Substituting, one sees that (18) is fulfilled, when x 
and 0 are solutions of the ordinary differential equations: 


dx 

dt 



1 




These can be immediately integrated, and the integration constants can be 
determined from the fact that for / = 0 we must get 5 (u — u 0 ) and for / = « 
the Maxwell distribution law. 


III. The Frequency Distribution of the Displacement 

§7. The problem is to determine the probability that a free particle in 
Brownian motion which, at / = 0 starts from x=x 0 with the velocity uo 
after the time t lies between x and x-hd.x*. It is clear that this probability 
will depend only on 5=.r — .r 0 , and on /. 


8 This equation has been derived already by Rayleigh (Phil. Mag. 32, 424 (1891) = Scient. 
Papers III, p. 473) and he gives also the fundamental solution (15). Later it has again been 
treated by v. Smoluchowski (Krakauer Per. 1913, p. 418). Because Rayleigh’s proof is a 
little artificial, and the treatment of v. Smoluchowski is not easily accessible, we thought it 
not superfluous to give the proof again. 

9 Comp. Lord Rayleigh, reference 8. 
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We will use again the momentum method, and calculate all the mean 
values s k ‘ . This goes in an analogous way as with the velocity. By integra¬ 
ting (11) again we find: 


u 


0 


* l 


/ 


.r = ,r 0 H——(1 - e~ 8t ) + I e 8 \h) | e**A (£)</£ 

8 J 3 

or integrating partially: 

«o, 1 1 /•' 

5 = x - *o = —tl - e~ 8t ) - e~ 8 ‘ I c*bl (£)</£ + — I 

0 d */ n 


( 21 ) 


8 


Taking the mean, gives: 


(4 A 


Mo 


5 = —(l - e~*‘) 

3 


( 22 ) 


which can be interpreted as the*distance travelled in the time / with the mean 

velocity u — u„ exp( — 3t). By squaring, averaging, and calculating the double 
integrals in the same way as before, we get: 


u 


2 ' _ 


"1 


Mo 


■ I 


= —j + — o - <• a, y + — ( - 3 + u-*> 


_ o 


201 


8 2 


8- 


28 


23 


where the constant r, is known from the corresponding calculation of «* u °. 
This result (23) was first derived by Ornstein; for very long times t it goes 


over in : 


u, 


r i 


8- 1 


2kT 

m3 


t 


the result of Einstein. For very short times l on the other hand, we get: 


- u 


S 0 = Hot 


5 2 = |< 0 */ 2 


The motion is then uniform with the velocity u 0 . Taking a second average 
over u o, remembering that u\ = kT/m, we get: * 


s = 0 
2kT 

5 2 = - (8t - 1 + «-") 

m/3 2 

which is the result quoted above (formula 10). The calculation of the hisrher 
powers goes similarly. In the result we get constants r 2 , r, ■ • • which have 
been determined in part II in the corresponding calculation of 7F' f rom the 
equipartition law. We can show in this way that for: 




832 


G. E. UHLENBECK AND L. S. ORNSTEIN 


again the normal Gaussian distribution law holds. For the details of the 
proof, see Note III. We get therefore: 


/'(•Vo, .v, /) = 


m/3 


2irkT{20l - 3 + 4e-0' - <;-’«')) 


exp 


m P 2 { x- - x 0 - ?/o(l - <r* , )//3| 2 1 

2kT 2/3/ - 3 + 4e-0‘ - e~ 2 ^ J 



Por large t this becomes of course the distribution law (7), already derived 
by Einstein. For /-+0 it becomes 5(*-* 0 ) as it should. 

§8. When we want to derive (24) in the same way as G(u 0t u , /) from a 

partial differential equation we run into the following difficulty. According 

to the general Eq. (19), we have to calculate Ax and Ax*. Now it follows from 

the equation of motion, when the prime denotes the value of the quantities 
at the time t-\-At, that: 


/ t+±t 

a a)di 

so that: 


- 0(x' - x) = - 0Ax = u' -u = Uoe-P'ie** 1 - 1 ) 
or : 


A.v = Hoe-* 1 At. 



When one now calculates in the same way A* 2 , then one finds.that Atf be¬ 
comes proportional to so that the function fi in (19) would become zero, 
and the differential equation would become: 


db dF 

- iioe-e' - 

dt dt 

which does not become the diffusion equation for t»p~ l . On the other hand, 

when we su ppos e /»/3 1 and At so large that we may apply the formula of 
Einstein for Ax 2 , we have: 


Ax = 0 
A^ 2 = 2DAt 

and this substituted in (19), gives immediately: 

dF d 2 F 

dt dx 2 



It seems impossible to derive from (19) the rigorous differential equation 
for F(xo,x,l), which for O s>/3 -1 would become the diffusion equation, and of 
which (24) would be the fundamental solution. The reason for this, it seems 
to us, is that in the derivation of (19) we suppose that the change Ax in the 
time At is independent of the fact that at the time /=0 the particle is at 
.v=x-o and has the velocity u 0 . 
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IV. The Brownian Motion of a Harmonically Bound Particle 

§9. We will first derive, following Ornstein 10 the equation (9) first pro¬ 
posed by Smoluchowski from macroscopic considerations. We have to de¬ 
termine again Ax and Ax*. Now, when there are external forces the equation 
of motion is: 

du 1 

— + = A{t) H- K(x ). 

dt m 


Integrating as in §8, we get: 

1 

u' — u — — 0(x' — x) -4- I A (£)d£ H- KAt 

J i m 

from which follows, when we may neglect the influence of the initial velocity: 


1 


0Ax = — K(x)At 
m 


(27) 


so that: 

1 1 

/.(*) = - K(x) = —K(x). 

0m j 

When again At is not too small, we may put : 

_ 2kT 

Ax 2 = - At = 2D At 

mi3 

and substituting in the general equation (19), w r e get: 


(28) 


dF 

dt 


i a d-F 

- —( KF) + D— 
J dx dx 2 


which is (9). 

Let us apply this to the case of a harmonically bound particle, for which : 


1 


m 


K(x) = 


— U)‘X 


where co is the frequency in 2tv sec. We get then: 

dF (j) 2 d d 2 F 

- =- (xF) + D - 

dt 0 dx dx* 

This is completely similar to the equation (20) for G(u 0 , u, t). We find there 
fore for the fundamental solution 


F(x o 




2ic0D(l 


* _^ 


CO 


exp 


2 (x - xoer<»*'*)‘)) 

1 - j 


20 D 


10 L. S. Ornstein, Proc. Acad. Amst. 21, 96 (1919). 
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which gives: 


- i 


. I' ° = X 0 C-<” m, * il 




kT 


WO ) 2 


+ 


(xo* - 


kT 


m co 


| e -(2u, 2 /^)< 


I his shows how the equipartition value is reached. For oi 2 very small we 

get approximately: 


X J * = ,V 0 


X* 


2 k 7' 

— x 0 - -f- -/ 

mQ 


which are the results for a free particle. We may not expect though, that the 

equations are generally valid. According to the derivation, there are clearly 
two limitations: 

a. Because we have used (27) and (28) which correspond to (26) in S8 we 
must expect (30) to hold only for times t»(3~ l 

MOW C Tm We , ave u in (28) USed the result {or ^ ree partide. we must expect 
(30) to hold only when 0 is large, the motion therefore being strongly over- 

amped his is also the reason why apparently there is no distinction be 

tween the periodic, aperiodic and overdamped cases in the result for * 2 '". 

... T ° Ret exact resu,ts ’ we have to use the same method as before. 
U e have first to integrate the equation of motion, and then take the average. 

* 1 ^ V m | ^ ¥ * 1 * « • . . now be treated separ¬ 

ately. We will indicate the calculations only for the periodic case. 

The equation of motion is: 

d-x dx 

— + 0 j t + = A{t) 

when at / = (), .r=A.* 0 and u =dx/dt = u 0 we get from this: 

2 w 2 xo -f- ( 3 uq 

u = e~* tn sin co x t -f uoe-w* cos co,/ 


2 to i 


+ 


-f 

OJ l J o 




P_ 

2 


x = 


P *0 4" 2 Mo 


2 CO [ 


e- (0l2)t si n co,/ + x 0 e~ »'«' cos co x t 4 


sin coi (/ — £) + coi cos coi(/ — £) | 

'-f 


d$ 


A ft)tf-^(‘-«)/*sinc oi(t-Z)dt 


where: 


COi 2 = CO 2 


4 


Supposing, in correspondence with (3): 


x ft u 


A(Q’ % ° = 0 
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this gives immediately, for instance: 


&Xo + Iiif) 


jrT'U' = _ 


2toi 


e lli >2 “ sin ai|/ -f x 0 e l * ,2)l cos cod. 


(31) 


The mean value here has to be understood as follows. We have a canonical 
ensemble of harmonic oscillators, from which at /=() we pick a sub-ensemble 
(A) of oscillators, which have a deviation and velocity x 0 , u o, resp. and which 
we follow in their motion. At the time / we take an average over the * of the 
different members of this sub-ensemble (A), and the result is then given 
by (31). If we would follow a sub-ensemble (B), of which the members at 
t= 0 had the deviation x 0 but arbitrary velocity, we would get at the time t 
a mean deviation, which will follow from (31) by taking the average over 
Ui). Since in a canonical ensembleof oscillators the deviation is not correlated 
with the velocity, we may put: 


Uo'* = 0 


— x 


kl 


u " = 


(32) 


Uisng this, we get: 


-sin co,/ -f- cos co ,t 

2co i 


(33) 


Let us now consider u 2 and x 2 . Using again the assumption analogous to 
(4): 




= (f>(t i — / 2 ) 

where <t>(x) is an even function with a sharp maximum at x = 0, and calcula¬ 
ting the double integrals exactly as before, we get: 

— //3*o 4* 2w 0 V t i 




2 CO, 


(<j/2)f s in w,/ + x 0 e~ (BI2)l cos <o,A 2 H-— (1 - e~ Bl ) 

) 2oji 2 (3 


where we have put: 


8 c 0 2 C 0 i ‘ 2 


(/3 - (3e Bt cos 2co,/ + 2u l e~ Bt sin 2coi/) 


-00 

» 

“30 


<t>(w) COS co |wdW 


4>{w)dw. 


The condition, that for t —>so we must get the equipartition value, gives us 
one relation between r, and r 2 . One would expect that from: 


lim u 2 




kT 
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we would get a second relation, hut the calculation of u 2 ' 0 " 0 shows that this 
is the same as the first. The fact that 0( w ) has such a sharp maximum sug¬ 
gests, that in the integral for nwe may replace cos^ u-by unity, which would 
make r, = r 2 . We can prove this more exactly by calculating and 

determining the limit for t— ♦ », which must be zero, because for /—>oo sub 

ensemble (A) must again become a canonical ensemble. We get in this 

way: 


2 (3kT 

r i = r 2 = - • 

m 

This solves the problem completely. Averaging again over using (32) 
we get: 



kT 

mu } 2 



~ )e-*{cos a„/ + — sin 
w«v V 2 ojj / 



which shows how the equipartition value is reached. So we can calculate 
all sorts of mean values. The further result is perhaps interesting, that: 

=x# l / kl \ / (3 \ 

xu ~ ;l~ _ x 'o 2 )e 01 sin o),/( co; «,/ -j-sin «,/ ) 

/ \ 2o>, / 


which shows how the correlation between * and w, beginning with being 
zero, oscillates and goes to zero again for /->«>. Of course, averaging over 
*o, we get ^ = 0 as it must be. 

§11. In the aperiodic case we get: 


~2 r ° 

X~ = 

■v°( 1 + 

(33a) 


«D(‘ + t)*""' 

(34a) 

The equipartition value is now reached monotonously, 
goes similarly, except that instead of the integral n, we havi 
integral: 

The calculation 
e to introduce an 

f 

T\ = 

• 

r t 

1 w 2 <t>(w)du>. 

' —00 



The calculation of X u 0 L proves then that this is zero, which could be ex¬ 
pected. 

In the overdamped case we get: 


=*„ / 3 

x = x 0 e w/2)< ( cosh a// H-sinh ut 

\ 2 a)' 

==x 0 / *7\ / 0 

* = -; + ( *o 2 ~Z —; )e 0, ( cosh a)'/ H-sinh a>'/ 

nuo 1 \ mo} 2 / \ 2to 

4-ao 

11 Here v r e use: J' 0(u))sinwiu> <fu> = 0, which follows from the fact that is an even 
function. 



) 


(33b) 



where: 
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a / 2 =-or = - a.', 2 . 

4 

The equipartition value is again reached monotonously. It is easy to show 
further, that when and t^>j3 1 these last equations go over into the 

results (30) of v. Smoluchowski, as we would expect according to the remarks 
at the end of §9. 

§12. The problem of the rotatorial Brownian motion of a small mirror 
suspended on a fine wire, has been treated recently by S. Goudsmit and one 
of us, 12 by a method analogous to the well-known treatment of the shot 
effect by Schottky. 13 If the displacement, registered during a time, long com¬ 
pared to the characteristic period of the mirror, is developed in a Fourier 
series, an expression was derived for the square of the amplitude of each 
Fourier component. It was found that this depended, besides on the tem¬ 
perature, on the pressure and molecular weight of the surrounding gas. 
This explains in principle, why the curves registered by Gerlach 14 at dif¬ 
ferent pressures, though all giving the same mean square deviation, are 
quite different in appearance. I he calculations were made under the condi¬ 
tion that the surrounding gas is much ratified, and though they can easily 

be generalized, the exact comparison with the experimental data of Gerlach 
is very difficult. 

The results (33) and (34) (when we replace m by the moment of inertia) 
are in this respect much better. They could be tested easily, and they hold 
for all pressures of the surrounding gas. They show that, though the mean 
square deviation depends only on the temperature, the correlation between 
successive values of the deviation depends in a more interesting way on the 
surrounding medium. Its influence is expressed by the friction coefficient 0. 

Notes 

I. To prove that for b = u — M 0 exp( — /3/) the normal Gaussian distribution 
law holds, we have to show that: 

[p n +i = Q 

IP* = 1 3 5 ■ • ■ ( 2 « — l)(U-j ^ 

We have from §5: 

U = 0 


£/ 2 = 

From (11) we get further: 



U3 ~ e f f f e " <t ‘ +b+il ^((i)A((,)A(( 3 )d( l d( 2 d^. 

° 0 * 0 J 0 

u G. E. Uhlenbeck and S. Goudsmit, Phys. Rev. 34, 145 (1929). 

U W - Schottky, Ann. d. Physik[57, 541 (1918). 

14 VV. Gerlach, Naturwiss. 15, 15 (1927). 
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According to the assumptions made about A(£) the integrand will be dif¬ 
ferent from zero only in the neighborhood of the line £, = £ 2 = £ 3 . Taking 
cylindrical coordinates with this line as s-axis, and using (5), we find : 



where r 2 denotes the constant : 



t 2 = f f </> 2 (r, 6)rdrdd . 

J 0 Jo 

1 he value of r 2 follows again from the equipartition law. For /—►» , Jp must 
go to zero, so that r 2 = 0. 

Going to the fourth power we find: 


t t t t 




0 0 0 0 


\\ hen £i and £ 2 are lying near each other and also £ 3 and (but far from 
si. £ 2 ). we will have according to (6): 


a a,)/i a u)a «,).4 (g) = a ax )a a 3 )Aa 4 ) 

so that this integration region will contribute: 


- W( 


T\ 


4d 2 


(c 2 *‘ - l) 2 . 


We will get this 3 times because we can divide A (£j) A(h) A(£ 3 ) A(£<) into 
two pairs in 3 ways. There remains the region in the neighborhood of the 

line = £ 2 = £. ( = £ 4 . I*or this we get, introducing cylindrical coordinates and 
using (5): 


— e-'t'U' 31 - 1 ) 

20 


where: 


J .0 


</> 3 (r, 6, d 2 )drdw 


For t—> * we get therefore: 


— 3ti 2 t 3 

lim U A =-f- — 

4/3 2 2/3 


but according to the Maxwell distribution law, we have 

3t ^ 

lim U* = lim u 4 = 3( lim w 2 ) 2 = —— 

/—♦» /—*qo /—♦ oo 
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so that r 3 = 0 and we get: 



To write down the general proof for (A) is tedious, because one has more 
and more integration regions to consider. However, since (A) holds for 
, one can convince oneself of the fact that only those regions where the 
s lying in pairs near each other give a real contribution. All the other 
regions give contributions proportional to constants r k (k> 1) which by the 
equipartition law prove to be zero. I his gives A 1 immediately and since the 
number of ways in which we can divide In objects into n pairs is 1.3.5 • • • 
(2w — 1) we get An also. 

II. When we substitute in (20): 


we get: 



bz dz b' l z 

~ — 2 T- y -1- 

dx dv dv 2 

~ * 

and we have to solve this when for x = 0, z=/(y) and for y= ±» f Z = Q 
By separating we find as a particular solution : 

A n e- n *D n (y)e-y t i* 

where D n denotes Weber’s function of the nth order 15 
We have then to determine A n : 

ce 

/(>') = T.A„D,Xy)e-S'< 

0 

which gives: 


A ’ ~ n !( 2-rr ) 1 


and we get for the solution: 


z(x ’ y) = 7 T- Dn{y)DM 


—e 


-m 


— 20 


0 


n ! 


(s) 


We have now to sum the infinite series. As Professor H. A. Kramers showed 

to us this can be done in the following way. Put, suppressing the arguments 
y and -q : ° 


M{x) 



14 Comp. Whittaker-Watson, Modern Analysis, p. 347 . 
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then: 


dM 

dx 


ac 


= E 


D n +\D nJr \ 


>—(n+l)x 


n ! 


Using the recurrence formula: 


D n± i{z) = zD n (z ) — nD n -i(z ) 


we get: 


dM 


dM 


_ _ 2 A yD n+l D n 4- vD n D n+ i — D n D n 

-— = yr,e Z M - e 2x - - 2 ^ - e~ (n+2)x . 


dx 


dx 


0 


n\ 


C ailing the last sum N and using again the recurrence relation, we find 

v / o i 2 i\ _ 2 yD n D n+ i -f- f}D n +\D n 
N = (y + v 2 - 1 )e~ 2x M — 2^ -- e -(n+3)x 

0 111 

Again using the recurrence relation, we find for the last sum 

L = (2yije~ 3x - e~ 4x )M - e~ 2x N. 

Substituting back, we get for M the differential equation: 

dM 

~ (1 — e 2z ) 2 -— = M j yr\e~ x — ( y 2 + r) 2 - l)e~ 2x + yt)e~ 3x — e~ 4x \ 

dx 

This we can immediately integrate, which gives: 


C{y,n) 

M = - exp 

( l-e - 2x ) l/2 


{- 


y 2 + v 2 ~ 2yrje 


2(1 


— 2ype~ x i 

-e~ 2x ) J 


The integration constant C(y,rj) can be determined from the fact that 


lim M = D 0 (y)D 0 (Tj ) = C(y, T J )e - (t ' i +’ l * )/2 


oo 


which gives: 


C(y, v) = e ( «A*V>/4 # 


Substituting in the solution ( B ) gives finally: 


z( 


r ’ y) = ^ II dr,f(r,) nh^) 


1/2 


exp 


i _ (y ~ v e *) 2 | 

l 2(1 — e ~ 2x ); 


which shows that the fundamental solution is then 5(y — y 0 )) is given by: 


G(yo, y, x) = 


1 


(2tt(1 - e- 2x )Y 


n 


exp 


( _ (y - yo e ~ z ) 2 \ 

\ 2(1 — e~ 2x ) J 


Introducing again / and u, we get (15). 

III. To prove that for 5 = 5 — w 0 //3(l — e~ 01 ) the Gaussian distribution law 
holds, we have to show again: 
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S 2 "+ l = 0 

S= 13-5 • • • (2n - 1)(S*)» (C) 

We have from §7: 

5 = 0 

5* = —-(2fSt - 3 + 4e-*‘ - e~- at ). 

The calculation of the 3-fold integrals in S 3 is analogous to the calculation 
of U * in Note I. We find that the result is proportional to r 2 , and from Note 
I we know that r 2 = 0 , so that: 

5 * = 0 . 

In the 4-fold integrals occurring in S 4 we have to consider only the regions 
where £i, £ 2 , £ 3 , £< are lying in pairs near each other, because the other re¬ 
gions will give results proportional to r 3 which is zero, as is proved in Note I. 
The calculation gives: 

5* = 3(5*)* 

as could be expected. The factor 3 comes again from the fact that we can 
divide £i, £ 2 , £ 3 , £ 4 into two pairs in three ways. In the same way as in Note 
I then, one convinces oneself further of the truth of the general relations (C). 
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1. INTRODUCTION 

I N 1930, Ornstein and one of us 1 tried to 
summarize and partially extend the existing 
theory of the Brownian motion for simple sys¬ 
tems like the free particle and the harmonic 
oscillator. Since that time the theory has been 
developed and clarified to a considerable extent, 
so that it seems worth while again to try to 
summarize the theory. In this we will restrict 
ourselves to the case of the Brownian motion of 
a system of coupled harmonic oscillators, or in 
the electrical analogy to the theory of the thermal 
noise in a linear, passive network. 2 It is now 
clear that in this case we have to do with the 
theory of the so-called Gaussian random process, 
and we shall try, therefore, to present the theory 
of the Brownian motion against the background 
of the general theory of the random process.* 

1 his will also allow us to show the connection 
with some of the mathematical literature on 
this subject. 

I here are two approaches to the theory of the 
Gaussian random process. In the first the atten¬ 
tion is focused on the actual random variation 
in time of the displacement, or voltage, or 
whichever variables of the system one is espe¬ 
cially interested in. One usually 4 develops this 
variable in a Fourier series in time, of which the 
coefficients can vary in a random fashion. A 
fundamental notion is the notion of the spectrum 
of the random process, and the connection be¬ 
tween the spectrum and the so-called correlation 
function is one of the basic theorems. For many 
purposes, and especially in the electrical case 
when the “noise” passes through non-linear 

‘ G. E. L'hlenbeck and L. S. Ornstein, Phys. Rev. 36, 
823 (1930). VYe will refer to this paper as I. 

1 Only in the last section, where we shall mention some 
unsolved problems, we shall go beyond this restriction. 

* Recently S. Chandrasekhar has also reviewed several 
aspects and applications of the general theory in Rev. 
Mod. Phys. 15, 1 (1943). Although there will be some 
overlapping, we hope that our review will complement the 
exposition of Chandrasekhar. 

4 It sometimes is convenient to use a development in 
other sets of orthogonal functions. 


circuit elements (like rectifiers for instance), this 
method is the most natural. Recently the method 
has been applied systematically to a whole series 
of problems by S. O. Rice, 6 and we shall call it, 
therefore, the method of Rice or the Fourier series 
method, and in the following we shall give only a 
short account of it. 

The second method is the method of Fokker- 
Planck or the diffusion equation method. Macro- 
scopically, for an ensemble of particles or sys¬ 
tems, the variations which occur are like a 
diffusion process. The distribution function of 
the random variables of the system will, there¬ 
fore, fulfill a partial differential equation of the 
diffusion type, and this is the basic equation of 
the method. 6 We shall discuss this method in 
more detail, mainly because, thanks to a recent 
article by Kramers, 7 one is now able to derive 
the distribution function for any of the random 
variables in the Brownian motion of a system of 
coupled oscillators. Thus it becomes completely 
clear that the two methods give identical results, 
and the relation between the two methods can 
then perhaps be better appreciated. 


2. THE GENERAL RANDOM PROCESS 

Roughly speaking, what we mean by a random 
process y(t) is a process in which the variable y" 


*S. O. Rice, Bell Tel. J. 23. 282 (1944); 25, 46 (1945). 
We shall refer to these papers as Rice 1 and II. One finds 
here also references to previous applications of the method. 

• For simple examples see I, and also R. Furth, Ann. d. 
Physik 53, 177 (1917) and Riemann-Webcr, 3rd ed. Vol. 
II, p. 177. In the mathematical literature the method has 
been analyzed by A. Kolmogoroff, Math. Ann. 104, 415 
(1931); 108, 149 (1933); and by W. Feller. Math. Ann. 
113, 113 (1936); Trans. Am. Math. Soc. 48, 488 (1940). 

7 H. A. Kramers, Physica 7, 284 (1940). 

* B that y is the displacement or velocity of a 

particle in Brownian motion or a fluctuating voltage or 
current when we have thermal noise. It may also denote 
a combination of two or more of such quantities, and we 
shall speak then of two-dimensional or more dimensional 
random processes. In the following, everything will be 
written as if y and t were continuous variables. This is 
not necessary; it may happen that either y or / or both 
y and t can assume only discrete values. We propose to 
let the words continuous and discrete refer only to the 
dependent variable y; while the words process and series 
refer to continuous and discrete t respectively. The well- 
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does not depend in a completely definite way on 
the independent variable / ( = time), as in a causal 
process; instead one gets in different observations 
different functions y(t), so that only certain 
probability distributions are directly observable. 
In fact the random process y(t) is completely 
described (or defined) by the following set of 
probability distributions: 

W x (yt)dy = probability of finding y in the 
range (y, y-\-dy) at time t. 

Wi(yxt \; y 2 t 2 )dy\dy 2 = joint probability of 
finding >- in the range (y lt yi+dyj at time 
ti and in the range (y 2 , y 2 -\-dy 2 ) at time t 2 . 
Wsiydi ; yztz', yst 3 )dy\dy 2 dy 3 = joint proba¬ 
bility of finding a triple of values of y in 
the ranges dy u dy 2 , dy 3 at times /,, l 2 , t 3 . (1) 


To determine the functions W n experimentally, 
it is clear that one needs a great number of 
records y(t) obtained from a great number of 
experiments on “similarly prepared 1 ' systems (an 
ensemble of observations). To find then, for 
instance, Wi{yt), one determines at a definite 
time t how often in the different experiments y 
occurs in a gives interval (y, y+Ay), etc. In most 
applications (and especially for the Brownian 
motion problems) we can make, however, a 
simplification because the processes are stationary 
in time. This means that the underlying “mecha¬ 
nism” which causes the fluctuations does not 
change in course of time. A shift of the /-axis 
will then not influence the functions W n , and as 
a result the set (1) becomes: 


And so on! The set of functions (1) must fulfill 
the following obvious conditions: 

(a) lV n ^0. 

(b) B' n(yili ; y 2 t 2 -• -y n t n ) is a symmetric 
function in the set of variables ydi, y 2 t 2 • • y n t n . 
This is clear since W n is a joint probability. 

(0 W k {ydx\ ■ ■-y k t k ) 

dy k +i- • dy n W n {y x ti • * * -yJ n ) 

since each function W n must imply all the 
previous lV k with k<n. I he set of functions 
(1) form, therefore, a kind of hierarchy; they 
describe successively the random process in 
more detail. 9 


known theory of Smoluchowski for the concentration 
fluctuations of a colloidal suspension is in our terminology 
an example of the analysis of a discrete random series. 
1 he general random walk problem is an example of the 
theory of continuous random series, etc. One finds a 
complete account of these examples in the article of 
Chandrasekhar. 

* I ar as we know, the first attempt to give a general 
theory of a random process is contained in two papers bv 
“1 S; 0™stem and "• C- Burger. Versl. Kon. Acad. Amst. 
27, 1146 (1919); 28, 183 (1919). Here the set of distribu¬ 
tions (1) and the property ( c) are mentioned. Compare 
further A. Kolmogoroff. Grundbegnffe drr Wahrschemlich- 
keitsrechnung (Berlin, 1933), p. 27; H. Wold. "A study in 
the analysis of stationary time series, Diss. Uppsala (1938)- 
B. Hostinky, Ann. Inst. H. Poincard, 3, 1 (1933); 7. 69 
(1937). The authors are aware of the fact that in the 
mathematical literature (especially in papers by N. 
Wiener, J. L. Doob, and others; cf. for instance Doob, 
Ann. Math. 43, 351 (1942), also for further references) the 
notion of a random (or stochastic) process has been 
defined in a much more refined way. This allows for 
instance to determine in certain cases the probability that 
the random function y(/) is of bounded variation, or 



Wi(y)dy = probability of finding y between y 
and y-\-dy. 

W 2 (yxy 2 t)dy x dy 2 = joint probability of finding a 
pair of values of y in the ranges dy\ and dy 2 , 
which are a time interval / apart from each 
other (/ is therefore =t 2 — t x ). 

And so on again. These functions can now be 
experimentally determined from one record y(t) 
taken over a sufficiently long time. One can then 
cut the record in pieces of length T (where T is 
long compared to all "periods” occurring in the 
process), and one may consider the different 
pieces as the different records of an ensemble of 
observations. In computing average values one 
has in general to distinguish between an ensemble 
average and a time average. However, for a 
stationary process these two ways of averaging 
will always give the same result, and one can, 
therefore, use either of them. 

3. CLASSIFICATION OF RANDOM PROCESSES 

The set of probability distributions (1) leads 
immediately to a method of classifying the 
random processes. 

(a) VVe shall call a random process a purely 
random process when the successive values of y 
are not correlated at all. This means that: 

W^Cyi/i: yzti) = W^Cy,/,) • Wi(y 2 t 2 ) 


continuous or differentiable, etc. However, it seems to us 
that these investigations have not helped in the solution 
of problems of direct physical interest, and we will, 
therefore, not try to give an account of them. 
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and analogously for the higher XV n . All the 
information about the process is then completely 
contained in the first distribution function \\\. 
When l is discrete, it is easy to give examples, 
but for continuous t, the purely random process 
cun only be considered as a kind of limiting case; 
in any actual example, the y j and y s will surely 
be correlated when the time interval t 2 — t , is 
small enough. 

(h) In the next more complicated case, all the 
information about the process will be contained 
in H\. Such processes are called Markoff proc¬ 
esses. For the more precise definition it is useful 
first to introduce the notion of conditional proba¬ 
bilities. We will write P 2 (yiiy 2 , t)dy 2 for the prob¬ 
ability that given y, one finds y in the range 
{y*, yi + dy-P) a time / later. Of course, one finds 
Pi from Wi according to 10 

W*(yiyi/) = ^Vi(yi)Pi(yi\yi, t ). ( 2 ) 

Pi must further fulfill the obvious relations 
(which also follow from the properties (a), (b), 
( c ), of Section 2.); 

Pi(yi\yi,t)^ 0, (3a) 

f'dy 2 P 2 (y x \y 2 ,t) = \, (3b) 

W l (y 3 ) = J W x {y x )P 2 {y x \y 2 ,t)dy x , (3c) 

while in the Brownian motion problems one also 
always has: 11 

lim Pi(yi\y 3 , /) = W x (y 2 ). (4) 

*-♦00 

Analogously one can introduce higher order con¬ 
ditional probabilities, and we will use an analo¬ 
gous notation; a bar will always separate the 
variables which are given from those for which 
the probability has to be found. All this holds, 
of course, still for any stationary random process. 
A Markoff process can now be defined more 

precisely by stating that for such a process the 
conditional probability that y lies in the interval 
(>*«, y n -\~dy„) at time given that y is equal to 

,# From now on we shall restrict ourselves to stationary 
processes. 

“ This property excludes, for instance, the existence of 
hidden periodicities. In the theory of noise it excludes 
the presence of signals.” 


y i, y*-‘-y»-i at the times (where 

/„>/ n _r - • >ti>ti) depends besides on yj n only 
on the value of y at the previous time Or 
in a formula, a Markoff process is defined by the 
equation : 

Pn(y it l, \ltl - • 1 I >'Jn) 

= -^2(> , n-l/»-l|yr,/n). (5) 

This makes it clear that all the FT* for n>2 can 
be found, when only \V 7 is known. One derives 
for instance easily from (5) that: 


H t(ydi, ya/j, yJi) — 


B'ity,/,. y 2 t 2 ) W 2 (y 2 t 2 , y a / 3 ) 


W x (y 2 t 2 ) 


and so on. It is clear, therefore, that XV 2 or P 2 
completely describes the process. However, one 
cannot take P- as an arbitrary function of its 
variables Besides the general relations (3) and 
(4), it must fulfill: 


p t{y\\yi, i) = J*dyP 2 (y t y, to)Pi(y\yi, t—t 0 ), ( 6 ) 

for all values of t 0 between zero and t. This 
follows immediately from the definition of a 
Markoff process and is called the Smoluchoivski 
equation. It is the basic equation for the theory. 

(c) In this way one can go on. The next class 
of processes will be completely described by 
giving \V 9 . However, in the physical applications 
there are very few examples studied of such 
higher order processes. Very often, when a 
process is not a Markoff process one can still 
consider it as a kind of "projection” of a more 
complicated Markoff process. Besides y, one then 
considers another dependent variable z (which 
may be, for instance, dy/dt or it may be a 
coordinate of another system), and it may be 
that for the two variables y, z combined, the 
process is then a Markoff process, so that: 

P-i(.y\Z \I >'22 2 , /) 

= I f dydzPi( y iZl I :V 2 - l o)P 2 (yz | y 2 z 2 , t-t 0 ). 

The Wi(y x y 2 t) which one obtains by integrating 
lV 2 (y lZl y 2 z 2 t) over z, and z 2 will then in general 
not be a Markoff process, and one can say that 
this is due to the fact that one has not given a 
complete enough description of the process. 
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Whether it is always possible to find the appro¬ 
priate variables z t , z 2 - • • (there may be more than 
one) so as to complete the given process to a 
Markoff process will, of course, depend on the 
physical “causes” of the fluctuation phenomena 
in question. As we shall see, for the theory of the 
Brownian motion, such a completion will always 
be possible, so that in some sense we will always 
have to do with Markoff processes. 

4. THE RELATION BETWEEN THE SPECTRUM 
AND THE CORRELATION FUNCTION' 1 


easily: 

f dfGJ) cos 2t/t, (11a) 

Jo 

from which follows by inversion: 

G(f) = 4 f dr(y(t)y(t+ r))*, cos 2t/t. (lib) 
Jo 

I his is the relation referred to in the title of this 
section. One can express it by saying that the 
correlation function 


Suppose that one considers for a very long 
time 7 a stationary random process y(t) whose 
average value is zero. Taking y(t) =0 outside the 
time interval T, one can develop the resulting 
function in a Fourier integral: 

y( 0= f dfA (f)e 2rift , (7) 



( y(t)y(t+T )) to 

<y>* 


and the normalized spectrum: 



G(f) 

*dfG(J) 


(12a) 


(12b' 


where A(f)=A*(-f), since y(t) is real. It is 
well known (Parzeval theorem) that: 




-f * 


A (/) | Mf. 


Using the fact that \A(f)\ 2 is an even function 
of/ and going to the limit T —one can write 
this equation in the form : 

(y% = Lim^ f y\l)dt= f dfG(f), (8) 

* J —ao J o 

where 

G(f) = Lim [ A (/) | * (9) 


are each other’s Fourier cosine transform, so that 
they are uniquely related to each other. For an 
almost pure random process, p(r) is a function, 
which starting from unity drops very rapidly to 
zero, and as a result S(f) = constant except for 
very high frequencies. We call this a white 
spectrum; of course, the case that S{f) = constant 
for all /, which corresponds to a pure random 
process, is a limiting case, which will never occur 
in* practice. When S{f) has a sharp maximum 
around f 0 , then p(r) will look like a damped 
oscillation with roughly the frequency /<>. 

5. SOME REMARKS ON THE THEORY OF 
DISCRETE RANDOM SERIES'* 


is the spectral density. 

Consider next the average value: 

1 (' +x 

(y( l )y(t-\-T))*, = Lim — I y(t)y(t + T)dt. (10) 

T-a o 7 J-oc 

By introducing the Fourier expansion (7) and 
using the Fourier integral theorem, one shows 


We will restrict ourselves to Markoff processes. 
The problem will then always be to determine 
P(n\m, sr ) when one knows P(n\m, t). Here P 
is the analogue of the P(yi\y 2 , t) ; y i, yj can only 
have discrete values n, m and also the time t can 
only have discrete values st with 5= 1, 2, 3, 
From now on we will drop the r and write also 
Q(n, m) for P{n\m, t) in order to emphasize that 


11 This relation is contained in the paper of N. Wiener, 
Acta Math. 55, 117 (1930) on generalized harmonic 
analysis. It was rediscovered by Khintchine, Math. Ann. 
109, 604 (1934). See also the dissertation of H. Wold for 
further references and for the formulation in the discrete 
case. In 1938, G. I. Taylor (Proc. Roy. Soc. 164, 476 
(1938)) gave a beautiful application of the theorem to the 
theory of turbulence. Cf. also Rice I, p. 310. 


'* The purpose of this section is only, to present some of 
the ideas which are of importance for the understanding of 
the Fokker-Planck method. For a complete discussion 
compare Hostinky, see reference 9 and also M. Fr^chet, 
Traiti du Calcul des Probability (1938), Vol. I, Part II, 
Section 3. For the discussion of the important application 
to the theory of the concentration fluctuations, see Chan¬ 
drasekhar, reference 3. 
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it is the basic probability which must be given 
from the "mechanism" or the "physical cause" 
of the random process. To find then P(ti\nt,s) 
one can try to make successive use of the 
Smoluchowski equation: 

P(n\m, s) = '£.k P(n\k, s— m). (13) 

However, for large values of 5 this is usually not 
practicable, and one has to look for other 
methods. 

It is instructive to write (13) in a different 
way by remembering that: 


that the point makes a step A to the right or to 
the left. If at 5 = 0 the point is at the position wA, 
what is the probability P(n\m, s) that at time 5 
the point is at the positions mA. It is clear that 
the basic transition probability Q(k, nt) is given 
by: 

Q(k , m) = k — 1) + £+1). 

Introducing this in (13) and dropping again th< 
initial state n, one obtains the difference equa 
tion: 

P(m, s) = \P(m + 1. 5— \)+\P(m — 1,5—1), (15 


Z-n Q(k, m) = 1, 

or 

Q(k,k) + T. m t Qik, m) = 1. 


which has to be solved with the initial conditior 
(14). The solution is very easy to obtain; witl 
v= [ n — m | one get s: 


where the prime means that the value m = k must 
be omitted. Using this and dropping in (13) the 
initial value n one can write Eq. (13) in the form : 

P(m, 5)-P(w, 5-1) 

= -Pirn, 5- 1)ZT Q(m, k) 

+ Zt' P(k, s-\)Q(k, m). (13a) 

One can interpret this by saying that the rate of 
change of P(tn, s) with the time ( = 5) is owing 
to the "gains" of P because of transitions from 
k to m minus the "losses" of P because of the 
transitions from m to all possible k. It is clear, 
therefore, that (13a) is completely analogous to 
the well known Boltzmann equation in the 
kinetic theory of gases. 14 One must solve such 
an equation for a given "initial" distribution; in 
our case this is the way the variable n comes in 
since: 

P(m, 0) = 6(n, m), (14) 

where S(n, m) denotes the Kronecker symbol. 

In many cases the process has the property 
that the dependent variable k can change in one 
step at most by ±1. This means that Q(k, m) =0 
except when m = k, k±\, and Eq. (13) or (13a) 
becomes then a rather simple difference equation. 
I o illustrate this we will consider two examples. 

(a) Discrete random walk problem in one 
dimension. This is the simplest possible case; a 
point can move on a straight line in steps A; at 
each time moment 5 there is an equal chance 



I he first probability distribution H'i(n) should 
of course become independent of n, and will 
therefore be not strictly normalizable except 
when one limits the number of positions. This 
is also in accord with the general relation (3c). 
One sees easily that in this case P(n\m,s), 
besides fulfilling the general Eq. (3b), fulfills in 
addition the special relation: 

En P(n I W, 5) = 1, 

and as a result the equation (analogous to (3c)): 

IT(m) = Zn W(n)P{n\m, s) 

has the solution \V(n) = constant. 

( b) An example of Ehrenfest 16 —Suppose now 
that the fundamental transition probability 
Q(k, m) has the form : 

R + k R-k 

Q(k ' k ~ l)+ ~2R~ &{rn ’ * + 1) ’ 

where R is a given integer. In the language of 
the random walk problem of the previous ex¬ 
ample, this means that there is an attractive 
center; the probabilities for making a step A to 
the right or left are not more equal but $(1 —k/R) 
and £(l+£/i?) so that the point will have the 


ir?° r 0156 t * ie mo * e cule3 of the gas can only 

colude a g a|f| St fixed centers or against other molecules 
which have a given velocity distribution. 


11 For description of the probability problem and for 
a more complete analysis see E. Schrodinger and F. 
Kohlrausch, Physik. Zeits. 27, 306 (1926). 
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tendency to go to the position * = 0. The differ¬ 
ence equation now becomes: 

n . R-\-m-\-\ 

P(m ’ =-TS- P{m + 1,5-1) 

IK 

/? — m +1 

+-^-P(w-1, 5-1), (17) 


is more natural to start (following Rice) with 
the Fourier development of the Gaussian random 
function y(t). 

Consider again the stationary random function 
y(/) over a long time T, and suppose that y(t) is 
repeated periodically with the period T. One 
can then develop y(t) in a Fourier series: 


which has again to be solved with the initial 
condition (14). We did not succeed in finding the 
solution; it is possible, however, to calculate 
average values. For instance it is easy to show 
from (17): 


(>n(s)) k ,= mP(m, 5 ) = 



(ttt (5 !))*»• 


Since for 5 = 0, (m)*, = n, one finds: 


(18a) 

which shows how the average position of the 
point goes to zero. In the same way one gets: 

(w l (5))*, = n*^l-^ 



° 8b) 

will therefore go to R/2 for 5-» *. This is 
in accord with the first probability distribution 
(which is also the stationary distribution, see 
Eq. (4)) for which one finds easily: 


W l (n) = 


(2R )! /1 \ 

n) l(R — n )! \2/ 


(* + 


2 R 


y( 0 = 52 (<** cos 2irf k t+b k sin 2rf k t), (19) 

k -1 

where f k = k/T. There is no constant term, since 
we will assume that the average value of y is zero. 
I he coefficients a k and bi are random variables, 
and we will assume, that they are all independent 
of each other and Gaussianly distributed with 
average values zero, so that one has for the 
probability that the a k and bi are in certain 
ranges da k , dbi the expression : 

W(a\af • • ; b\bi- • •) 

= 11—E- exp [-(a,*+V)/2«»], (20) 

k (TkW Ztt 

where c k 2 = (a k 2 ) A , = (b k i ) k , = G(f k )/T. G(J) is again 
the spectral density (cf. Eqs. (8) and (9)), since: 

(y*(t))*> = I2k ((at 1 )*, cos* 2-irfkt 

+ <**% sin* 2rf k t) 

(20 

With these assumptions one is now able to 
derive all possible distribution functions for the 
Gaussian random function y(t). Asa preparation 
one needs: 


One can verify that.Wi(n) fulfills the equation: 

Wx (»)-Z* Wx{h)Q{Jk t n) 
which is a special case of Eq. (3c). 

6. THE GAUSSIAN RANDOM PROCESS; 

METHOD OF RICE 

(a) Assumptions 

The Gaussian random process is characterized 
by the fact that all the basic distribution func¬ 
tions (1) are Gaussian distributions, and one 
could take this fact as the defining property of 
the process. However, since as we shall see, the 
spectrum essentially determines everything, it 


(b) A Theorem about Gaussian Distributions 


Suppose the variables X\Xf • • x n are distributed 
according to: 




1 


<_i <t,-(2t)* 


exp 



Let yov • *y. (s^n) be 5 linear combinations of 
the x»: 


yk='La ki x i , * = 1,2 •••5 
«—1 

where the a ki are constants. One can prove 
easily 18 that the y k will be distributed according 


18 See Note I of the appendix. 
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to the 5-dimensional Gaussian distribution: 


P(yi■ • y.) = 


l 


(2 x)" 2 fM 


1 * 

Xexp-— Z PuykVi 

2B k j-t 


• ( 22 ) 


Here B k i is the cofactor of the elemeni b kl in the 
matrix b k i, where: 


n 

&*i = Z = (23) 

i— 1 

and B is the determinant of the matrix b k i. As a 
special case take, for instance, 5 = 2. One then 
gets the two-dimensional Gaussian distribution, 
which according to (22) can be written in the 
form : 


P(y\yt) = -- 


l 


2w<rr(l — p 2 ) 4 


Xexp 


1 

yt 

2(1 —p 5 ) 

a 2 


+ — 
— 2 


2 p 

—y\ yi 

or 


II 


(24) 


where <d = (yd)*,, T 2 = (y 2 2 ) A , and (yiy*)*. = <rrp; p is 
the correlation coefficient. 


since y and y at a given / are not correlated. 
One gets namely: 

(y(0y(0>%® Z* 2ir/t sin 2irf k l 

Xcos 2T/ t /«-a* 2 ) te + (6 t %) = 0. (26) 

3. The joint distribution of y(/,) and y(/,). 
This will again be a two-dimensional Gaussian 
distribution. One gets: 

1 

<y(*.)y(/*)>*. = - £* C(A) cos 2 wMh-ti) 

G(f) cos 2rfrdf. (27) 

The correlation depends therefore only on 
t = Ii — t\, as it should be since the process is 
stationary. 

4 In this way one can go on. One can consider 
for instance the third distribution function 
yit-i, yj/j). which will be a three-dimen¬ 
sional Gaussian distribution depending only on 
/•* —/i and — One can find the four-dimen¬ 
sional Gaussian distribution W(y x y lt y 2 j/,, r). One 
can bring in the acceleration //(A and its distri¬ 
bution functions, and so on. 



(c).Distribution Functions for y(t) 

Using the general theorem mentioned above 
one can now derive from (19) any kind of distri¬ 
bution function referring to y(t). The method is 
best explained by considering a few examples. 

1. The distribution of y at fixed t. According 
to (19) y is for a given t a linear function of the 
basic variables a k , bi. We know, therefore, that 
the probability distribution for y will be Gaussian 
with a mean square value given by (21). The 
time t has disappeared, and this is as it should 
be since W i(y) must be independent of t, because 
the process is stationary. In the same way one 
can compute the distribution of the velocity y(t). 
This is also a linear function of the a*, bi, so the 
distribution will again be Gaussian with the 
mean square value: 

6 /( 0 % = 4* 2 f PG(J)df. (25) 

Jo 

2. T he distribution of y and y at a fixed /. 

This will now be a two-dimensional Gaussian 
distribution, which is, however, especially simple 


7. FURTHER REMARKS ON THE METHOD OF RICE 

1. We have seen that for a Gaussian random 
process all the distribution functions can be 
determined when one only knows the spectrum 
or the correlation function. In the actual prob¬ 
lems of the Brownian motion this spectrum can 
be found from the so-called I^angevin equations 
or in the electrical analogy from the circuit 
equations with thermal noise sources. For examples 
see Sections 9 and 10. It should be emphasized, 
however, that for many applications it is an 
advantage that one can leave open the question 
of the actual shape of the spectrum. 

2. A disadvantage of not knowing the spec¬ 
trum is that it does not allow a classification of 
the Gaussian processes, so that one does not 
know which distribution function describes the 
process completely. The different type of proc¬ 
esses correspond to different type of spectra. 
I.°r >nstance one can show 17 that a one-dimen- 
sional Gaussian process will be Markoffian only 
w'hen the correlation function p(/)=exp (-#) so 

43! T 3M i (i942 S ) firSt ° Ut by L ‘ Doob * Ann. Math. 
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that according to (11) the spectrum must be 
~ 1/03 2 + gj 2 ). To prove this one determines with 
the method of Rice the distribution functions 
Wiiyiyiyd and One, therefore, knows 

also the conditional probability Pt{y\yi\y 3 ). For 
a Markoff process this must be identical with 
PiiyAyz) and one finds that this can only be the 
case when the correlation function p(r) fulfills 
the functional equation : 

p(/3-/i)=p(/,-/ 1 )p(/,-/,). (28) 

The only non-singular solution of this equation is 

p(r) = exp (-/Sr). 


a greater variety of possible spectra, corre¬ 
sponding to the different forms Q may have. 

4. One should point out, that sometimes the 
distribution functions which one derives with 
Rice s method will have no meaning since some 
of the integrals over the spectrum are divergent. 
For instance when G(f)^ l/(a*+/ 2 ), the distri¬ 
bution functions in which the velocity y(t) appear 
have no meaning since (see Eq. (25)) (£% will 
not exist. In this case one may call the process 
non-differentiable. The degree of differentiability 
will be characteristic for the process and will 
depend again on the spectrum. 


3. I his theorem can be generalized to n- 
dimensional Gaussian processes. The dependent 
variable y now denotes an n-dimensional vector 
with components x u x t , • • *x n . Instead of a 
correlation function one gets a correlation matrix: 



'(xi(/)xi(*-Ft))a,- • -(*i(0*n(* + 0)A»' 
.<*n(/)*i(/ + r))*,- •■W0Xn(i+r)> A „ 


. (29) 


From the stationarity of the process, follows: 

R(t) = R(-t), (30) 

where R denotes the transposed matrix. Follow¬ 
ing the same reasoning as for the one-dimensional 
process one can show 18 that the n-dimensional 
Gaussian process is Markofftan only when R(t) 
fulfills the matrix functional equation: 

R(/ 3 -/i) = R(/ a -/ 1 )R(/ 3 -/ J ), (31) 


8. THE GAUSSIAN RANDOM PROCESS; 
METHOD OF FOKKER-PLANCK 

(a) Basic Ideas 

It is best to start with the discrete random series 
(cf. Section 5). Suppose that the basic transition 
probability P(n\m, r) or Q(n, m) has the prop¬ 
erty that in the time r n can only change by zero 
or by ±1. This was, for instance, the case in 
the examples (a) and ( b ) discussed in Section 5. 
Consider now for this case the limit in which n 
and the time sr become continuous. The Smolu- 
chowski equation will then become a partial 
differential equation of the first order in the time 
coordinate and of the second order in the space 
coordinate. For instance, in example (a), the 
Smoluchowski equation becomes Eq. (15) which 
may be written : 

P{m, s) —P(m, s- l) = $[P(m + l, s— 1) 

— 2 P(m, s— 1 )+P(m— 1, s— 1)J. 


where we have still assumed that R(0)=I, the the limit that sr — t and mA = x become con- 
unit matrix. 19 The only non-singular solution is tinuous variables, this clearly goes over into: 


R (r) = eQ\ (32) 

for r>0, Q is a constant matrix, which is in 
general not symmetric, 20 so that its eigen¬ 
values may be complex. There is now of course 


18 This result seems to be contained in a recent paper by 
I. L. Doob, Ann. Am. Stat. 15. 229 (1944). See also Note 
11 of the appendix, where we give some details of a more 
direct proof which we owe to Dr. M. Kac. 

'•This is no loss in generality, since it can always be 
achieved by using the proper linear combinations of the 
components of the n-dimensional vector y. In the physical 
language this mpns that we have used such coordinates 
that the energy is a sum of squares. 

10 For r <0 R(r) = exp (— Qr) in accordance with (30). 


( dP/dt ) = Did'P/dx 3 ), (33) 

when Z7 = LimA 2 /2r. One gets, therefore, the 
well-known heat conduction or diffusion equa¬ 
tion. In the same way one shows that in example 
( b ) one gets from (17) in the limit the equation: 


dP 

dt 


= 0— (xP)+D 
dx 


d'P 

dx 1 ' 



where 0 = Dim 1/tR. 

In this limit the problem of finding the prob¬ 
ability distribution P(x 0 \x, t) becomes then the 
problem of finding the fundamental solution of 
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the partial differential equation of the diffusion 
(or parabolic) type into which the Smoluchowski 
equation has degenerated. We mean by this the 
solution which for / = 0 becomes the Dirac 
singular function 5(x —x 0 ). This corresponds to 
the condition (14) in the discrete case anil 
expresses again the fact that for l = 0 one is 
certain that x = x 0 . For (33) this solution is 
given by: 

1 

Pfxo|x,/)=———exp [-(x-x 0 ) 2 ., 4/)/]. (35) 

{AtirUt ) 1 

It is easy to show that this is the limit into 
which the solution (16) of the discrete case goes 
over. For Eq. (34) the fundamental solution is 
given by: 2 ' 

1 

P(x 0 \x, /)=-- — exp [-(x-x) 2 2a 2 ], (36) 

(2ttct 2 ) 

where <x)«. = x 0 exp (- fit) and <r 2 = ((x-x) 2 }*, 
= (D d)[l — exp ( — 2/3/)]. It is clear that these 
average values follow also in the limit from (18a) 
and (18b). 

One should point out that one gets in the 
limit a diffusion equation only when P(n m, r) is 
such that in the time r n can only change by zero 
or ±1, or, less precisely, when in small times the 
space coordinate can only change with small 
amounts. In the general case, the Smoluchowski 
equation will become in the limit an integro- 
differential equation which is of the same type 
as the Boltzmann equation in the kinetic theory 
of gases. 


(b) Assumptions 

In the continuous case we will start from the 
Smoluchowski equation in the form : a 

P(x\y, / + A/) = JdzP(x\z, t)P(z\y, At). (37) 

This assumes, therefore, that the process is a 
Markoff process. The moments of the change in 
the space coordinate in a small time At are 


“See. for instance. I. Section II. Equation (36) is also 
a special case of the solution derived in Note IV of the 
appendix. 

For simplicity we consider the process to be one 
dimensional, since the generalization to the n-dimensional 
case is obvious^ We follow the notation and the exposition 
ol Kolmogoroft, Math. Ann. 104, 415 (1931) 


given by : 

a n (z, At) = Jdy(y-z) n P(zly, Ai). 

and we shall assume that for A1—+0, only the 
hrst and second moments become proportional 
to At so that the limits 

1 

A ( 2 ) = Lim —< 1 ,( 2 , Al), 

At 

, (38) 

B(z) = Lim ~-a 2 ( 2 , A/), 

exist. 1 his assumption expresses the fact that 
for these processes in small times the space 
coordinate can only change with small amounts. 
In the actual problems of the Brownian motion 
this assumption can be proved and the average 
values A (c) and B(z) can be calculated from the 
Langevin equations or in the electrical analogy 
from the circuit equations with thermal noise 
sources.* 3 Just as in the method of Rice, these 
equations are, therefore, the real basis for the 
theory of the Brownian motion. 


(c) Derivation of the Fokker-Planck Equation 

Consider the integral 

[iyR^y±, 

J dt 

where R(y) is an arbitrary function, which goes 
to zero for y— =t « sufficiently fast. Replacing 
the differential quotient by the limit of the 
difference quotient and using the Smoluchowski 
equation in the form (37) one can write: 

/ dP 1 r 

dyR(y)—~ = Lim — | dyR(y) 
dt At J 


'X\_P(x\y,t + At)-P(x\y, /)] 

= Lim f d y R (y ) f dzP(xlz, t)P(z\y, At) 


2 . O} 

In the double integral, interchange the order of 
integratio n and develop R(y) in a Taylor series 

a For examples see Sections 9 and 10. 
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in (z-y). Because of (38) one can stop at the 
term with (z — y)- and one gets: 

OP r 

dyR(y)—= \ dzP(x \z, t) 
dt J 

XlR'(z)A(z) + iR”(z)B(z)']. 

Integrating partially and writing y for z one 
obtains: 


electrical problem is of course the (L, R) circuit, 
and the circuit equation is: 

L(di/dt) + Ri = E(f), (40b) 

where E(t) is a purely random fluctuating e.m.f. 
(the thermal noise source), which has a spectral 
density ARkT. We will combine these cases by 
writing (40a) and (40b) in the form : 



J r OP d Id 2 1 

d yR ( y )\—-+-( Ap )- (B p ) =0 
L dt dy 2 dy 2 J 

Since this must hold for any function R(y), the 
expression in the square brackets must be zero, 
which gives the general Fokker-Planck equation : 

OP d 1 d 2 

_ r -__ [ ^ W p ]+ __ [ SWP ] i (39) 

of which, of course, (33) and (34) are special 
cases. For an w-dimensional process one gets 
analogously: 

OP d 

— E^. (y )P] 

dt dy, 

+- £ - - [^u(y)-P], (39a) 

2 *. i dy k dy t 

where again the A, and the B kl are the first and 
second moments defined analogously as (38). 

9. THE BROWNIAN MOTION OF A FREE PARTICLE 5 ' 

(a) Assumptions; The Langevin Equation 

f'or a free particle (mass m, velocity v) the 
equation of motion will be: 


(dy/dt)+/3y=F(t) (40c) 

and by taking 4 D as the spectral density of the 
purely random F{t). This means that w eassume: 26 

<F(/))*, = 0, (41a) 

(R(t i)F(ti))», = 2Db(t\ —/ 2 ). (41b) 

I his is, however, not enough; besides being 
purely random, we must assume that F(t) is 
Gaussian. This can be expressed in different ways. 
Either one can postulate the Gaussian distribu¬ 
tion of the Fourier coefficients (see Eq. (20) 
where now a* 2 = const. = 4 D/T) or one can assume 
the two properties: 26 

<E(/,)E(/ 2 )-..E(/ 2 . +1 ))a. = o, (42a) 
(F(t\)F(ti) • • • F(t in )) k , 

= £ (FdJFitj^-iFMFd,))*--- (42b) 

all pairs 

where the sum has to be taken over all the 
different ways in which one can divide the 2n 
time points /r--/ 2n into n pairs. It is easy to 
show the equivalence of these two definitions 
(see Note 111 of the appendix). 


m(dv/dl)+fv = K(t), (40a) 


(b) The Spectrum of y(t ) 


where / is the friction coefficient, and A'(/) is the 
fluctuating force, of which the average value is 
zero and which has a very sharp correlation 
function and therefore, a practically white spec¬ 
trum. The spectral density of K{t) is 4 fkT where 
k is the Boltzmann constant and T the tempera¬ 
ture of the surrounding medium. The analogous 


54 Compare I, Sections II and III. The first complete 
derivation of the distribution functions obtained in Sections 
9 and 10 was given by L. S. Ornstein and W. R. van Wyk, 
Physica 1, 235 (1934). The derivation from the Fokker- 
Planck or Kramers equation was found independently by 
Ming Chen Wang, Dissertation, Ann Arbor (1942) and 
by Chandrasekhar, reference 3. 


Since F(t) is Gaussian it is clear that y{t) will 
also be a Gaussian random process with a 
spectrum : 


G V (J) = 


AD 


0 2 +( 2 t /) 2 



,ft The second equation follows from (lib) since: 

Gr(J) = 4D = 2J dr cos 2vfr(F(t)F(t + r))^- 

?6 This is the starting point of some of the work of 
N. Wiener on the theory of the Brownian motion. The 
physical justification of the assumptions (41) and (42) 
comes from the Maxwell-Boltzmann distribution law, 
which in the theory of the Brownian motion is always 
postulated and not derived. Compare also I. 
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This corresponds to a correlation function p(f) 
= exp ( — 01) and the second probability distribu¬ 
tion is, therefore, the two-dimensional Gaussian 


distribution: 


Wt(y>ytt) 

0 



2rD(\-p *)* 



0 1 


Xexp 

yr+y*" 2pviyj) , 

, (44) 


2/9(1 - p *) J 


since: 

/% X 



(>%= Gy(f)df= D/0. 

Jo 

(45) 


According to the theorem of Doob y(t) will be a 
Markoff process, so that \\\(y x y-.t) gives the 
complete description of the process. 

(c) The Fokker-Planck Equation 

The average values A(y) and B(y) can now 
be computed by means of (41) and one finds: 

A(y)=-0y, B(y) = 2D. (46) 

The proof is simple; integrating (40c) over a 
short time At one gets: 


Ay= — 0yAt -f- ^ d*F({). 


Therefore: 


A (y) = Lim-= -0y, 


A<— 0 A/ 

since (F)* = 0. Further: 

<+ai 


(Ay'). = 0>;y>A/’+J fd(d v (F(()F (,))„. 


and from (41b) one shows easily that the double 
integral is 2DAI, so that: 

B(y) = Lim^^ = 2Z>. 

A1—0 A/ 

In the same way it follows from (42) that all the 
higher moments of Ay go to zero in the limit 
A/—»0, so that all the assumptions of §8, b are 
fulfilled.* 7 With the values given by (46) the 

nhv,ir/l h ^!: 1 i b€ f e,TlphaS i! Zed P^P 5 again that from the 

H2Sn P 2!| t ?irn eW theSe assu ™P tio ns (and. therefore, 

( J 2) > are necessanly only approximations. 
The basic equation is always Boltzmann’s integral equa- 


Fokker-IManck equation becomes: 

dP d d-P 

— = (j—(yP)+D-- 

at ay av 1 


(47) 


This is identical with (34), so that the funda¬ 
mental solution P(y 0 \y, t) is given by (36) (for 
the proof, cf. Note IV). For /—»x one gets: 

W,(y) = Lim P(y 0 \y, /)=(--) 'exp 

» \2irD/ \ 2 D/ 

in accordance with (45). For the second proba¬ 
bility distribution: 

H' 2 (yiy 2 /)= W\(y\)P(y\\y it t) 

one gets again Eq. (44) That y(t) is a Markoff 
process has now, of course, been assumed from 
the beginning.* 8 

10. THE BROWNIAN MOTION OF A SIMPLE 
HARMONIC OSCILLATOR 

(a) The Langevin Equation 

Suppose now that instead of (40c) we have the 
second-order differential equation : 


d 7 y 
dt 


~+0j t +^y=F(t). 


(48) 


This describes clearly the Brownian motion of a 
simple harmonic oscillator or the thermal noise 
in a (R, L, C) circuit. For the F(t) we assume 
again the basic properties (41) and (42). 

(b) The Spectrum and the Correlation Matrix 

Since F(t) is Gaussian, it is clear that y(t) will 
also be a Gaussian random process with a 
spectrum: 


Gy(f) = 


4 D 


-(2*/)* + 2W/9/+ Wo 2 i ! ’ 


(49) 


tion Only when in each collision the velocity of the 
particle can change very little, then the Boltzmann equa¬ 
tion can be approximated by the diffusion Eq. (47) 7t is 
very mstrucuve to compare the derivation abcW with the 

pisSSSStSSHKI 

ss.'ssjivScSrs 1 ““ the £ 
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from which follows according to (11a) 

<y(0y (*+*■)> a. 

2D r x cos ur 

-- -—- da> 

T J 0 (oJo 2 ~ C*J 2 ) 2 -f*/ 3 2 CJ 2 

D / 0 \ 

=-« 5r/2 | cos wird-sin ci >it I, (50a) 

/3u) 0 2 V 2wi / 

where ui 2 = w 0 2 - (/3*/4); the formula will always 
be written for the underdamped case; for the 
aperiodic case let oi—*0 and for the overdamped 
case put wi = uo'. 

Of course, y(t) is not more a Markoff process. 
However, from the physical situation and also 
from the general theorem of Doob one must 
expect that y(t) is the "projection” of the two- 
dimensional Gaussian Markoflf process Qy(f). P(0D 
where p(t) =dy/dt. The correlation function (50a) 
must be extended to the correlation matrix: 

/<y(0y(*+ r ))* (y(0P(<+T»A,\ 
\<^(0y(<+ T )>*» (P(OP(<+0>*/ 

and one finds easily that: 

+ *))*• = 2* f dfG v (f)f sin 2 t/t, 

Jo 


(c) The Fokker-Planck Equation 

Replacing the Langevin Eq. (48) by the 
simultaneous equations: 

dy/dt = p and dp/dt +(/?/>•+- w 0 2 y) = F(t), (48a) 


one finds easily for the average values occurring 
in the two-dimensional Fokker-Planck equation 
(cf. Eq. (39a)): 



(A/>) Av 

A i= Lim-= — (/3p+cj 0 2 y); 

At 

Bn= Lim-= 0; 

At 

. {AyAp) k , 

B 12 = Lim-— 0; 

At 

. (Ap% 


B 2 2 = Lim 


At 


= 2D, 



dP d _ d*P 

- —I-—[ (PP +"o*y) P ]+ D— 

<9y dp oP z 


(51) 


which has to be solved with the initial condition : 


2D r 
ir Jo 


co sin cor 


o (coo 2 —co 2 ) 2 + / 3 2 co 2 


da), 


D 


and : 

(P(0P(* + T ))*» 


H- e~ Br ‘ 2 sin coir, 

/3co, 


= 4* 2 f dfG v {f)P cos 2 t/t, 

J o 

2D T* co 2 COS cor 

=- I - du>, 

IT Jo (coo 2 —<O 2 ) 2 + /S 2 C 0 2 

D / 

= _ e -flr/ 2 ( 

0 V 


0 . 

COS COlT-Sin CO 1 T 

2coi 


) 


(50b) 


(50c) 


The complete description of the process will now 
be given by W t {yip\, y 2 p 2 , t), which is a four- 
dimensional Gaussian distribution. We will not 
write it down since for the discussion it is 
easier to consider the conditional probability 
P 2 (yipi |y 2 Pi. 0- Consider first, however, 


P(yp . 0) = «(y—yo)5(p—po). 

For the solution it is simpler to work with the 
independent variables: 

Zx = p+ay: z 2 = p+by, (52) 

where: 

a=\(i + iu} i and b = $p — uai. 


Equation (51) is then transformed into the more 

svmmetrical form: 

* 


dP 

dt 


d d 

b -( Zl P)+a— 

dz\ oz 2 


(ZtP) 

«(= 




(51a) 


and this is a special case of the equation solved 
in Note IV of the appendix. One finds that the 


"This is a special case of the equation of Kramers, 
Physica 7. 284 (1940). Kramers takes a general force A (y) 
instead of the harmonic force —wo *y. pis derivaUon is 
essentially the same as the one given above. Une should 
emphasize perhaps, that with a general force K{y) the 
process [y(0, />(<)] is still Markoffian. but it is not more 
Gaussian, since the basic Langevin equation is then not 
linear anymore. 
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fundamental solution of (51a) is a two-dimen¬ 
sional Gaussian distribution in z t and z 3 with 
the average values: 


{zi)^ = z l 0 e~ bl , <£j)a, = z 20 «-°‘, 


(53) 


and the variances: 


D 


<(*»-*.)% = -( 1 

0 

a 


(54) 


2D 

<(£l — 2l)(fil —£*))<, =--(1—e“ <#+ * , 0. 

a -bo 

where Zio, Zjo are the initial values of Zi, z 3 
corresponding to >’o and p 0 . 

(d) Discussion 

Since z t and z, are connected with p and y 
by the linear relations (52) it is clear that 
D(Payo\Py,t) will also be a two-dimensional 
Gaussian distribution in p and y. One obtains 
from (53) and (54) for the average values and 
the variances the expressions: 


<P>. 


= — e-H'fbn 

Cdl \ 


0 . 

cos to it -sin ui it 

2 


) 


CJo 


Wi 


sin U >1 /, 


p o 

(y) *.= —sin io\t 

Wl 


y° / /3 \ 

H—wi cos wiH— sin on* ), 
wi V 2 / 


Dr l 

((P~P) *)*. = — 1- er*' 




W] 


X (a>i 5 + $/9 5 sin 5 wjf 


—/9a»i sin uni cos 


<«o*(y -£)% = —[ 1 —e-e* 

0L ui 1 


«»oJ. 


X (wi 5 + $£ 5 sin 5 an/ 

sin <oit cos co it) 




Dcoo 


(wo (p-p)(y-v))* = — -t-»' sin 5 u>it. 




(55) 


One has, of course, 



djy 

dt- 


dy 

- J r0—-\-ioo 1 y = 0. 
dt 


The center of the Gaussian distribution moves, 
therefore, like the harmonic oscillator starting 
from the initial values p 0 , yo- In the (p, y) plane- 
one gets (in the periodic case) for the orbit the 
well known spirals. For small l: 

((P ~ p)*)h=2Dt, 

((y-yy)*,=\Di l , 

(ip - p)(y - y))*=Dt 2 ‘ 

One sees, therefore, that the initial two-dimen¬ 
sional <5 function 5(p — Po)S(y-yo) will become 
first a narrow ellipse elongated in the p direction. 
The distribution ellipse will then turn and 
broaden out till at the time t = w/on it has become 
again a circle. This process will repeat on a 
larger and larger scale with the period v/wi (see 
Fig. 1). The center of the distribution will 
come nearer and nearer to the origin and finally 
of course the P(poyo\ py, t) will become the 
Maxwell-Boltzmann distribution. 


11. THE BROWNIAN MOTION OF A SYSTEM OF 
COUPLED HARMONIC OSCILLATORS 

The generalization to more complicated sys¬ 
tems does not involve anything new, so that we 
will only give an outline of the main results. We 
will use for a change the electrical language and 
we will consider, therefore, an arbitrary linear 
network of n meshes. The circuit equations are 
then :*° 


f (I. dly< I R dy < 

E \ Lir dp +Rir to 


G„Y, 


)- 


£ £.>; 

o-l 


i= 1, 2 • • - n. (56) 


The E ix is the fluctuating thermal e.m.f. in that 
part of the resistance of the ith mesh which is 


,0 For the precise definition of the matrices L u , R if , Gu 
666 A- Guillemin, Communication Net• 

works, V ol. I, Chap. IV. All these matrices are symmetrical. 
Note, however, that /?<, (i^j) does not need to be positive. 
11 ‘ 9 . n , egaU Y e, . w * len .‘" the resistance common to the *th 
and jth mesh the positive directions chosen for the currents 
are opposite to each other. The y, are the mesh-charges. 
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Fig.1. 


not in common with any other meshes. The 
Eij (i^j) is the fluctuating thermal e.m.f. in the 
resistance R ti \ £,,= £>, if in R,j the positive 
directions chosen for the currents are in the 
same direction ; if they are opposite to each other 
then Eij= — E„. The E xi are again supposed to 
be Gaussian random processes with a constant 
spectrum. We assume especially: 


process. From the physical situation one must 
expect in addition that the 2n variables 
• -y n (/), dyi/dt- • ■dy n /dt ] will form a 2n- 
dimensional Markoff process, governed by the 
Fokker-Planck equation: 


dP 2 " d 1 iz 


a 2 


dt 


— i dXi 


2 i. M dx,dXj 


(D ti P), (58) 


{E ii {t x )E ii ( < t2))^2R ii kT6^-t l )\ 
(EiMEait,))*, = 2\Rij\kT5(t ,-/,); 

(£,>£*/)*, = 0. 


(57) 


In addition one needs, of course, assumptions 
analogous to (42). 

Since the Eqs. (56) are linear it is clear that 
each of the yj(t) will be a Gaussian random 


where denote the variables yi m "y»> 

dyi/dt- • dy H /dt. From (56) and (57) one finds 
further that: 

Ai=Zt ciikXk, (59) 

where the 2 n by 2 n matrix a is of the form: 


( 0 1 Y 

V—L-*G — L~'R/ 


( 60 ) 





12 


THEORY OF THE BROWNIAN MOTION 


33 7 


Finally one gets for the 2n by 2n matrix D the 
constant matrix: 

D= (o 2*7T 'RL ')' (<S1) 

To find the fundamental solution of (58), it is 
best to make first a linear transformation of the 
x, (analogous to (52) in §10): 


values the matrix equation : 

x = <r*'x 0 . ( 69 ) 

This follows from (67) which can be written as 

Z = r*‘Zo, 

where the diagonal matrix A,, = X,6 i; . Now z=cx 
so that x = c _, z and : 


(62) 

where the matrix c is the matrix which diagonal- 
uzes a, so that: 

5- y = ^iCn. (63) 

The eigenvalues X, are of course the 2 n roots of 
the equation : 

Xa„) = 0. (04) 

One can easily show that this equation is 
identical with 


Del{Lij\- - f- = 0, (64a) 

and it is well known that for a linear passive 
network the roots of this equation must have a 
negative real part, and the same must hold 

therefore for the X,. The Fokker-Planck equation 
now' becomes: 


dP d 1 a* p 

~=~T.i X»~ (ZiP)-\-~ £ <r,y-, 

^ & Z * 2 dZybZj 

where: 


(65) 


o = cDc. (66) 

The fundamental solution of (65) is derived in 

Note IV of the appendix. One gets a 2»-dimen- 

s, °nal Gaussian distribution with the average 
values: 


(z,)*, = 2 ,o exp (X,/) (67) 

and the variances: 

Mii=((2.-f i )(2y-2,)>*. 


x = c 1 z = c- , e A 'z 0 =E — c-‘A"z 0 . (70) 

Equation (63) can be written in the matrix form : 

cac-‘ = A, (71) 

from w hich follows that A" = ca^c" 1 . Substituting 
this in (70) one obtains (69). 

bor the matrix of the variances: 

&.> = ((*.-*.)(*/-x,))*. 

one obtains from (68): 


b = c- 1 yc-‘. (72) 

Since the real parts of the X, are negative it is 
clear that for /—* =c all the average values z, go 
to zero. 1 he distribution function / > (x l - 0 |jCi,/) 
must become in the limit /—*cc the Maxwell- 
Boltzmann distribution law', which means that: 


Lirn b -1 = 

I -♦ X 


1 

—G 
kT 


0 






To show this from (72), one starts from Eq. (68) 

which in the limit can be written in the 

form: 

Ay + yA= — a. 

Substituting y = cbc and using (66) and (71) one 
finds that b has to fulfill (always in the limit 
t—* a>) the equation: 


“ ^j^-D-cxp (X<+Ay)0, (68) 

where z i0 are the initial values of the r,. Trans¬ 
forming back to the original variables one 
gets of course again a 2»-dimensional Gaussian 
distribution. Combining the variables x, in a 
column matrix x, one can write for the average 


ab-}-ba= — D. 


(74) 


This determines, of cource, the matrix b uniquely. 

From (72) follows also that b is symmetric so 
that we can put: 



where Xj and X 3 are symmetric n by » matrices. 
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From (74) follows then: 

X 2 = 0, LX 3 = GXi, RX 1 G + GX 1 R = 2*rR. 

By inspection one sees that these equations are 
fulfilled by: 

Xi = kTG~ l ; X 3 = kTL~ l ; X 2 = 0, (75) 

and since the solution of (74) is unique this 
must also be the only solution. Equation (75) is, 
of course, equivalent with (73). 

The same distribution function follows, of 
course, from the method of Rice. One has to 
start then from the correlation matrix, for which 
one finds from the circuit Eqs. (56): 

kT r +cc 

0 'r( 03 '«(* + T ))*» = —J due”' 

X[Z->(^)RZ-‘(-^)] rf , (76) 

where Z (p) is the matrix: 

Z(p) = Lp 2 +Rp-fG. 

In order to see how in the method of Rice the 
Maxwell-Boltzmann distribution is reached, it is 
sufficient to prove the theorem of the equi- 
partition of energy: 



where V is the potential energy 

V=hZG r .y r y.. 


From (76) one obtains: 

= £. Gr.iyry,)* 


kT r + ® 

— I (^[GZ-'MRZ-H-iu.)],,. 

T J_oo 


(78) 


To calculate the integral,* 1 observe that: 

Z(io))—Z( —io)) = 2io>R. 


Eliminating R in the integral (78) one finds: 



kT r^dw 


kl r 
Tt J_ 


[GZ-Hio,)]^, (79) 


o> 


where one has to take the principal value of the 
integral. Since the determinant of Z(ico) has no 
zeros in the lower half of the complex w-plane, 
it can be easily seen that the integral in (79) is 
— xt times the residue of the integrand at o> = 0. 
Since Z -, (0) = G -1 it is clear that the residue is 
unity, so that one obtains the equipartition 
theorem (77). 

12. SOME UNSOLVED PROBLEMS 

Since we may have created the false impression 
that with the derivation of the fundamental 
probability distribution all problems in the 
theory of the Brownian motion have been solved, 
it may be useful to list a number of unsolved or 
partially solved problems. 

(a) The Approach to the Barometric Distribution 

It should be emphasized that only for harmonic 
forces one gets the simple theory of the Gaussian 
random process. For a constant force the problem 
becomes already much more complicated. For 
instance for a gravitational field (directed to¬ 
wards the negative x axis) the Kramers equation 
becomes: 

dP dP dP d[ dP 

— = -p -+g—+— epP+D^r 

dt dx dp dp\_ dp 

The trouble is now, that one needs a reflecting 
boundary, say at x = 0 in order to prevent the 
particles from disappearing towards x= — 00 • We 
feel sure that this means the condition : 

P(0,p,l)=P(0, -p,t). (81) 

We have been unable to find the solution of (80) 
(for x>0, — oo<p<-J-co) which fulfills the 

condition (81) and which for / = 0 becomes 
6(x — x 0 )5(p — p 0 ). One can show” that for the 
stationary case the Kramers equation and the 
boundary condition (81) determines uniquely the 
barometric distribution: 

( 0 gfi \ 

(b) First Passage Time Problems 

One may ask for the probability that the 
random variable y starting from the value y=yo 



* l For this proof we are indebted to Dr. J. Schwinger. 


A proof was communicated to us by Mr. M. Dresden. 
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reaches the value y = vi for the first time in a 
time between / and t+dt. In the usual theory of 
the Brownian motion (which is based on the 
ordinary’ diffusion Eq. (33)) 3J such first passage 
time problems have been considered and solved 
by Smoluchowski and others. 31 The method of 
Smoluchowski can also be used for a one¬ 
dimensional Gaussian Markoff process y(t). One 
can show, for instance, that the probability 
distribution H'(y 0 . t)dt of the first passage times 
to reach y = 0 starting from y 0 is given by: 


( 2/3 \ * / 0v o * \ 

— ) exp ( -~~z 2 )dz, (82) 


where 


z = r-*‘( l-e-* 1 )-*. 


However, the generalization to processes y(t) 
which are “projections” of Markoff processes 
seems quite complicated to us. For instance, we 
have not succeeded in finding, even for a free 
particle, the distribution of the one-sided first 
passage times if the damping is small, so that 
one has to use the exact Kramers equation. To 
extend the method of Smoluchowski it is neces¬ 
sary to introduce the idea of an absorbing 
boundary say at x = 0. We feel sure that this 
means the condition: 

/TO, p, /) = 0 for all p>0 (83) 

when the particle has started from x 0 >0. How¬ 
ever, to find solutions of the Kramers equation 
with the boundary condition (83) seems even 
more difficult than to find solutions with the 
boundary condition (81). 

(c) The Recurrence Time Problem 

One may ask for the probability that the 
random variable y starting from y = a returns to 
the value y = a for the first time in a time between 
t and t+dt. 31 Or in other words, what is the 


Kramers, reference 29, has shown that one obtains 

, t ,..» S «ia qU f t,0n «?, r x\ he , corres P° nd ing one if there is an 
outside force /C(y)) from the Kramers Eq. (SI) (with 

replaced by K{y)) in the limit of strong damping. 

M Cf. for instance, R. Furth, reference 6. and for the 

rand ° m M - Kac ' A ""- 

14 For the definition of the mean recurrence time and 
the mean persistence time see the basic paper of Smolu- 

,en .V Slt * . Bcr ' 1 J 24 ' 339 ( ,915 )’ Smoluchowski 
restricts himself mainly to discrete random series. Already 

in this case the question of the distribution of the recur- 


distribution of the time intervals between suc¬ 
cessive a-values of the random function y(t). A 
formal solution of this problem has been given 
by Rice (II, Section 3.4, Eq. (11). p. 64). How¬ 
ever, even for the simple case of the harmonic 
oscillator the actual discussion of the solution 
has not been achieved. 


(d) The Distribution of the Average Value 

One may ask for the probability distributions 
of the random variable: 



f K(s — t)y(s)ds, 


(84) 


where K(x) is a given function. A special case of 
(84) is the average of the random process y(t) 
over a time interval of length T. Of course, 
when y(t) is a Gaussian random process then 
also z(t) will be Gaussian, and the problem is 
trivial. But for other types of processes y(t) the 
problem is quite difficult. Rice (II, Section 3.9) 
has discussed some of the average values of z(t). 
Recently M. Kac and A. Siegert have succeeded 
in finding the complete solution for the case that 
y(t) is the sum of the squares of two independent 
Gaussian processes, which have the same prob¬ 
ability distributions. 


(e) The Distribution of the Absolute Maximum 
of a Random Function y(t) in a Given 
Time Interval T 

For Markoff processes one can show that this 
problem is equivalent with the first passage time 
problem, so that it is of the same degree of 
difficulty. 


APPENDIX 

Note I. Proof of Eq. (22) 

One uses the integral representation of the 
Dirac 6 function : 


1 r +x 

b(x-x') = — I dt exp [it(x — x')], 


rence times seems to be quite difficult. For the simple 

?h^ r fi te / and0m W * lk problem (example (a) of Section^) 
*2* VT st p , ass ? ge time and the recurrence time problem 
can be solved exactly. But already for example (b) of 
Section 5 we have failed to find the solution. 


130 


I 

340 


M I N G CHE N WA N G AND G . E . UHLENBECK 


which allows one to write: 



1 


( 2 ir)"' 


2+4 


CTiC7o 


-f* 

n 

dxi - ■ dx n exp [-1 £ (x, 2 /*. 2 )] 

1 

—ac 



* n 

dt x - ■ -dt. II exp [itkiyt-Y. a*.*.-)]. 

*-l 1 

— ® 

Interchanging the integrations over the x, with 
those over the /* one can easily carry out the 
integrations over the x, and one gets: 



Note that M is symmetric because of (30). 
Analogously one has for the second probability 
distribution 

y(/ 2 )) = C 2 exp ( — \ Y PjkZjZk), 

i.k-l 

where the 2 n by 2 n matrix is the inverse of 

( R(0) R(/,-/i)\ 

V *(*»-*«) r(o) J 

For a Markoff process P(j(h)y(tt) I y(/a)) = Wt/W t 
should be independent of y(/i). This leads to 
the conditions: 

a# = 0 , when j = 1 , 2 • • • n and 

* = 2n+l, •••3», (87) 


•fx 



— ac 

• « 

Xexp [t £ yktk-i Y bkitkti'], (85) 

i *. j-i 

where the are given by (23). One sees, 
therefore, that exp ( — %Ybkitkti) is the character¬ 
istic function of the probability distribution 
P(y i■ ’ ‘yi)• It is a standard result 38 that from 
(85) follows that P is an 5 -dimensional Gaussian 
distribution whose matrix is the inverse of the 
matrix b k i, and this is just what is expressed by 
Fq. ( 22 ). 


Note II. Proof of the General Theorem of Doob 

Denote the 3n components of the vectors 
y(/i), y(M. y('a) by z,z 2 - • z 3n . According to the 
general theorem ( 22 ) one then can write the 
third probability distribution in the form: 

3 n 

Wa(y(h), y(/a), y(/ 3 )) = C 3 ex P (-§ Y «>**/«*). 

where the matrix ajk is the inverse of the 3n by 
3n matrix: 


M = 


R(0) R(/*-/i) R(/s —/i)' 

R(^l-/ 2 ) R(0) R(^3 —/ 2 ) 

,R(/i-/») R(/i-/») R( 0 ) 


• ( 86 ) 


Comp, for instance H. Cramer, Random Variables 
and Probability Distributions (Cambridge Tracts No. 36, 
1937), p. 110. 


ocji = 0jk, when 7 = 1 , 2 - • n and 

*= 1,2 -2 n. ( 88 ) 

In order to calculate the inverse of M we 
resort to the following formal trick. We treat M 
not as a numerical matrix but as a matrix whose 
elements are matrices. The rules of multiplication 
are the same but in taking inverses one must be 
careful because of possible non-commutativity. 
We want then a 3 by 3 matrix X, whose elements 
are n by n matrices such that: 



x„ 

x , 2 

x 13 ' 


I 

0 

O) 

MX 

X 2I 

X 22 

x 23 

= 

0 

I 

0 



X 32 

x 33 , 


,0 

0 

I 


Using ( 86 ) this leads for instance to the three 
matrix equations: 

R(0)Xu+R(/ 2 -/,)X„+R(/,-*i)X„=0, 

R(/i - / 2 )Xi 3 + R(0)X 23 +R(*s - / 2 )X 33 = O, 

R(/i-/3)X, 8 -f-R(/ 2 -/ 3 )X 23 +R(0)X 3 3 = I. 

Condition (87) says that Xi 3 = 0; assuming 
further that R(0) = I, which as mentioned in 
footnote 19 is no loss in generality, these equations 
become: 

R(/i - /»)X 23 + R(/, •- *i)X 33 = 0 , (89a) 

X 23 + R(/ 3 -/ 2 )X 33 = 0, (89b) 

R(/ 2 -/,)X 23 +X 33 = I. (89c) 

R is a non-singular matrix. One can eliminate X 23 
from the last two equations and one gets: 

{R -‘(/ 2 - 1>) - R (/* - / 2 ) 1X 33 = R-'fo ~ tt). 
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The matrix in the curly brackets cannot be 
singular since DetR~ x {t 2 — h) ^0, and therefore: 

X 3S = {—/.) — / s ) |- , R-*(/* —/•). 

and : 

Xjs= R(/j —/*) {— /*) 

R(f a — 1 2 )) ~ * R~ * (/2 — tj). 

Substituting in (89a) one gets as the condition 
on R: 

R(f» —<») = R(/* ——/*). (90) 

which is Eq. (31). One must calculate also the 
other elements of X and in the same wav the 
matrix in order to show that the condition 
( 88 ) is now automatically satisfied so that (90) 
is also the only condition to be imposed on the 
correlation matrix R. 


for the Gaussian distribution. One can show * 7 
that still more explicitly by calculating the 
characteristic function of the distribution func¬ 
tion ir(a 4 ) f which is given by: 


X 

(exp (»{a*))-w=L 

* —0 


—j— 


m 


= L (-!)•- 


n «-0 


n ! 



n 

= exp 



using (91) and (92). Therefore: 




1 he same distribution 


one finds for: 


Note III. Proof that the Properties (42) Imply 
that F(t) is a Gaussian Process 

From (42a) follows immediately that the 
average values of all the odd powers of the 
Fourier coefficient: 


2 r T 

dk = — I dt cos 2 t/jc//•"(/) 

/ J n 


are zero. One gets further: 

T 

(% = — f f dl x dl 2 cos 2-rfkti 


Xcos 2irfkti(F(t i )F(t 2 )) l 


8 D 

r* 




cos 2 Jr fkt 1 


Xcos 2x/ t / 2 5 (/ 1 —/ 2 ) 
_8D rr 4D 

I ^ l cos 2xftt\ = —. 

J n T 


(91) 


From (42b) follows then that the average values 
of the even powers of a* are given by: 

(a* 1 ")*. = 1 • 3 • 5 • • • (2n - 1 )<a*%» (92) 

since the number of ways in which we can divide 
the 2 n time points / 1 , t 2 -'-t 2n into n pairs is 
1 • 3 • 5 • • • ( 2 n — 1 ). Equation (92) is characteristic 


2 r T 

^ = — J dt sm 2irf k tF(t), 

and it is also easy to show that the different a k 
and bi are independent of each other, so that 
the complete distribution function \V(a&■»••• •, 
bib 2 - • •) will be given by ( 20 ) with <r k * = 4D/T. 


Note IV. The Fundamental Solution of 

Equation (65) 

The problem is to find the solution of: 


OP d 

— =-Z.x.—0’.P) + i £ 
61 


d 2 P 



which for / = 0 becomes: 


(93) 


P= Hyi — yio)5(yi — y 20 ) • • • &(y n — y n0 ). ( 94 ) 

Introduce instead of P its Fourier transform: 

/(£!• • • tn, 0 



dyi- • • dy n P(y x • • • y n , /) 


Xexp [-z £, ^]. (95) 

From (93) follows that / has to fulfill the linear, 
first-order partial differential equation : 

d f ~ V 

J t ~ "abb- (96) 

” T* 1 * 5 was Pointed out to us by Dr. A. Siegert. 
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The subsidiary equations are: 

dt d£ i d£ 2 

1 X 2 £ 2 

= dfa _ df 

Xn£« \f E ^ijfalj 

These can easily be integrated; one finds that 
the general solution of (96) is given by: 

fill' ' ' In, 0 

= til i exp (XiO, fa exp (X 2 /) • • • fa exp ( \ n i)) 

Xcxp [ + 2^^iSrJ (97) 

where ^ is an arbitrary function. Now for / = 0 
one sees from (94) and (95) that: 

fill - ■ - In, 0) =exp [-* Ey l,yj o]. 


Therefore the arbitrary function \J/ must be: 

Ml i ‘■In, 0) =exp F—- E a w~—* Ey feyyo], 

L ^ ./ Ai + Ay J 

and one obtains for /: 

/=exp Ey fayjo exp (Xy/) 

+" E {1-exp [+ (X,+Xy)0} 1. (98) 

^ »y Aj-f-Ay J 

This is the Fourier transform of an w-dimensional 
Gaussian distribution with the average values 

( yi)*=yio exp (x<0, 

and the variances: 

<(yi-9i)(yj-& y)>fc= - r~r[i ~ ex P (X,+Xy)0- 

X, + Xy 
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Mathematical Analysis of Random Noise 

By S. O. RICE 

Introduction 


T HIS paper deals with the mathematical analysis of noise obtained by 
passing random noise through physical devices. The random noise 
considered is that which arises from shot effect in vacuum tubes or from 
thermal agitation of electrons in resistors. Our main interest is in the sta¬ 
tistical properties of such noise and we leave to one side many physical 
results of which Nyquist’s law may be given as an example . 1 

About half of the work given here is believed to be new, the bulk of the 
new results appearing in Parts III and IV. In order to provide a suitable 
introduction to these results and also to bring out their relation to the work 
of others, this paper is written as an exposition of the subject indicated in 
the title. 

W hen a broad band of random noise is applied to some physical device, 
such as an electrical network, the statistical properties of the output are 
often of interest. For example, when the noise is due to shot effect, its 
mean and standard deviations are given by Campbell’s theorem (Part I) 
when the physical device is linear. Additional information of this sort 
is given by the (auto) correlation function which is a rough measure of the 
dependence of values of the output separated by a fixed time interval. 

The paper consists of four main parts. The first part is concerned with 
shot effect. Ihe shot effect is important not only in its own right but 
also because it is a typical source of noise. The Fourier series representa¬ 
tion of a noise current, which is used extensively in the following parts, may 
be obtained from the relatively simple concepts inherent in the shot effect. 

The second part is devoted principally to the fundamental result that the 
power spectrum of a noise current is the Fourier transform of its correlation 
function. This result is used again and again in Parts III and IV. 

A rather thorough discussion of the statistics of random noise currents 
is given in Part III. Probability distributions associated with the maxima 
of the current and the maxima of its envelope are developed. Formulas 
for the expected number of zeros and maxima per second are given, and a 
start is made towards obtaining the probability distribution of the zeros. 
When a noise voltage or a noise voltage plus a signal is applied to a non- 
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linear device, such as a square-law or linear rectifier, the output will also 
contain noise. The methods which are available for computing the amount 
of noise and its spectral distribution are discussed in Part IV. 
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Summary of Results 

Before proceeding to the main body of the paper, we shall state some of 
the principal results. It is hoped that this summary will give the casual 
reader an over-all view of the material covered and at the same time guide 
the reader who is interested in obtaining some particular item of informa¬ 
tion to those portions of the paper which may possibly contain it. 

Part I—Shot Effect 

Shot effect noise results from the superposition of a great number of 

disturbances which occur at random. A large class of noise generators 
produce noise in this way. 

Suppose that the arrival of an electron at the anode of the vacuum tube 
at time t = 0 produces an effect F(t) at some point in the output circuit. 
If the output circuit is such that the effects of the various electrons add 
linearly, the total effect at time t due to all the electrons is 

1(0 = £ F(t - Ik) ( 1 . 2 - 1 ) 

AT»—OO 

where the k electron arrives at and the series is assumed to converge. 
Although the terminology suggests that I(t) is a current, and it will be 
spoken of as a noise current, it may be any quantity expressible in the form 
(1.2-1). 

1. Campbell’s theorem: The average value of /(/) is 


F(t) dt 


( 1 . 2 - 2 ) 


and the mean square value of the fluctuation about this average is 


ave. [/(/) - 7(/)] 2 = v 


F*(t) dt 


(1.2-3) 
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where v is the average number of electrons arriving per second at the anode. 
In this expression the electrons are supposed to arrive independently and at 
random. ve~' 1 dt is the probability that the length of the interval between 
two successive arrivals lies between t and t -f- dt. 

2. Generalization of Campbell’s theorem. Campbell’s theorem gives 
information about the average value and the standard deviation of the 
probability distribution of /(/). A generalization of the theorem gives 
information about the third and higher order moments. Let 

4- oo 

/(() = - ft) (1.5-1) 


where F(t) and t k are of the same nature as those in (1.2-1) and • • - fli , 
, • • • a k , • • • are independent random variables all having the same 
distribution. Then the « th semi-invariant of the probability density P(I) 
of I = l{t) is 

Xn=u7 n f [F(/)] n dt (1.5-2) 

J— OO 

The semi-invariants are defined as the coefficients in the expansion of the 
characteristic function f{u): 


log./(«) = £ («o" 

n-i n! 


(1.5-3) 


where 


/(«) = ave. e" u = £ 


+oo 


oo 


P(I)e iIU dl 


The moments may be computed from the X’s. 

3. As v —► cc the probability density P(7) of the shot effect current ap¬ 
proaches a normal law. The way it is approached is given by 


P(I) -cTW) - 


X3 <r 4 (3 ) 


3! 


* (*) 


+ 


r x 4 cr 5 

L 4! * 


<4> ■ a ^‘T <6, (*)] + 


(*) + 


X3 <J 

~72 


(1.6-3) 


• • 


where the X’s are given by (1.5-2) and 




1 _ 

-\/ 27r dx n 



Since the X’s are of the order of */, cr is of the order of v' 2 and the orders of 
» X 3 o- , X 4 cr and \\<j 1 are p 1/2 , iT 1 , v ~ m and v" 3/2 respectively. A 
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possible use of this result is to determine whether a noise due to random in¬ 
dependent events occuring at the rate of v per second may be regarded as 
‘'random noise” in the sense of this work. 

4. When /(/), as given by (1.5-1), is analyzed as a Fourier series over an 
interval of length T a set of Fourier coefficients is obtained. By taking 
many different intervals, all of length T , many sets of coefficients are 
obtained. If v is sufficiently large these coefficients tend to be distributed 
normally and independently. A discussion of this is given in section 1.7. 

Part II—Power Spectra and Correlation Functions 

1. Suppose we have a curve, such as an oscillogram of a noise current, 
which extends from t = 0 to / = oo. Let this curve be denoted by /(/). 
The correlation function of /(/) is \p{r) which is defined as 


oo 


L 


dt 


(2.1-4) 


where the limit is assumed to exist. This function is closely connected 
with another function, the power spectrum, w(f), of /(/). /(/) may be 

regarded as composed of many sinusoidal components. If I{t ) were a 
noise current and if it were to flow through a resistance of one ohm the 
average power dissipated by those components whose frequencies lie be¬ 
tween / and f + df would be zv(J) df. 

The relation between w(f) and ^(r) is 


w 


l 


00 


L 


00 


(2.1-5) 


( 2 . 1 - 6 ) 


When I(t) has no d.c. or periodic components, 


w 


(/) = Limit 2 1 S( T f) 1 


(2.1-3) 


T —oo 


where 


T 

s(f) = [ m 

J o 




dt. 


The correlation function for 


is 


/(/) = A + C cos (2tt/o* — <p) 


= A 2 + ^ cos 27t/ot 


(2.2-3) 


These results are discussed in sections 2.1 to 2.4 inclusive 


4 
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2. So far we have supposed /(/) to be some definite function for which a 
curve may be drawn. Now consider /(/) to be given by a mathematical 
expression into which, besides /, a number of parameters enter. w(f) and 
\P(t) are now obtained by averaging the integrals over the possible values 
of the parameters. This is discussed in section 2.5. 

3. The correlation function for the shot effect current of (1.2-1) is 


= v £ 


-f OO 


oo 


F(t)F(t + r)dt + 


v [ F(t) dt 
J— 00 


( 2 . 6 - 2 ) 


The distributed portion of the power spectrum is 

wi(/) = 2v | s(f) | 2 


where 



(2.6-5) 


The complete power spectrum has in addition to u\(f) an impulse func¬ 
tion representing the d.c. component lit). 

In the formulas above for the shot effect it was assumed that the expected 
number, v, of electrons per second did not vary with time. A case in which 
v does vary with time is briefly discussed near the end of Section 2.6. 

4. Random telegraph signal. Let /(/) be equal to either a or —a so that 
it is of the form of a flat top wave, and let the lengths of the tops and bot¬ 
toms be distributed independently and exponentially. The correlation 
function and power spectrum of / are 


Hr) 

w(f) 


oV 2 " H 


2 a 2 n 

2/2 , 2 
7T / + M 


(2.7-4) 

(2.7-5) 


where n is the expected number of changes of sign per second. 

Another type of random telegraph signal may be formed as follows: Divide 
the time scale into intervals of equal length h. In an interval selected at 
random the value of I(t) is independent of the value in the other intervals 
and is equally likely to be +a or —a. The correlation function of Kt) is 
zero for | r | > h and is 


for 0 < 


r 



< h and the power spectrum is 



5 


(2 7-9) 
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5. There are two representations of a random noise current 
especially useful. The first one is 


which are 


— ,!C (<*" cos Ui n t + b n sin w n t) (2.8-1) 

where a n and b n are independent random variables which are distributed 
normally about zero with the standard deviation VMJjAf and where 

"■ = 2 tt /„ , f n = n &f 

The second one is 


A' 

^(0 c n COS (a >n t — (p n ) 

n—1 


( 2 . 8 - 6 ) 


where <p n is a random phase angle distributed 
(0, 27r) and 


uniformly over the range 


c„ = [2w(J n )Af] m 

At an appropriate point in the analysis N and Af are made to approach 

in mty and zero, respectively, in such a manner that the entire frequency 

band is covered by the summations (which then become integrations). 

6. 1 he normal distribution in several variables and the central limit 
theorem are discussed in sections 2.9 and 2.10. 

Part III Statistical Properties of Noise Current 

1. The noise current is distributed normally. This has already been 
discussed in section 1.6 for the shot-effect. It is discussed again in section 

3 '1 US ' ng the conce Pts introduced in Part II, and the assumption, used 
throughout Part III, that the average value of the noise current /(/) is zero. 
The probability that I(t) lies between I and 1 -f dl is 

^ -1 2/2*o 

V2^o 6 ( 3 - 1 " 3 ) 

where \£ 0 is the value of the correlation function, ^(r), of I(t) at r = 0 

to = t(0) = j£ w{f) df, (3.1-2) 

w(f) being the power spectrum of /(/). to is the mean square value of 
/(/), i.e., the r.m.s. value of I(t) is 

The characteristic function (ch. f.) of this distribution is 


ave. e 


iul(t) 



6 


(3.1-6) 
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2. The probability that I(t) lies between h and h + dl, and /(/ -p r) 
lies between 1 2 and 1 2 -f- dl% when / is chosen at random is 


[*S - Vr) 


21 — 1/2 dl 


1 ^/ 2 r 

2.- exp L 


d'O I 


1 “ *o/ 2 2 + 2*^/,“] „ „ 

J a2 ~ 4) 


where \p T is the correlation function ^(r) of /(/): 


>7M = f w(f) cos 2tt/t df 
Jo 


The ch. f. for this distribution is 


3. The expected number of zeros per second of I(t) is 


1 r®r = 

7 r L >7(0) J 


l /*»</) d f 

/ M/)df 


(3.2-3) 


.0 >/(l)+i'r/(l+T) ^0 / 2 , 2\ 

e - e = exp [_ 2 + l ' ) - trUi' (3.2-7) 


(3.3-11) 


assuming convergence of the integrals. The primes denote differentiation 
with respect to r: 


*"(T) = iL *(r). 


For an ideal band-pass filter whose pass band extends from f a to f b the 
pected number of zeros per second is 


ex- 


fi/t -/TT 
L 3/6 - /J 


(3.3-12) 


When/„ is zero this becomes 1.155/* and when/, is very nearly equal to 
f» it approaches /*+/,. * 4 

4. The problem of determining the distribution function for the length 
of the interval between two successive zeros of I(t) seems to be quite diffi- 
It. In section 3.4 some related results are given which lead, in some 
circumstances, to approximations to the distribution. For example for 
an ideal narrow band-pass filter the probability that the distance between 
two successive zeros lies between r and r + dr is approximately 

dr _ a 

2 11 + a\r - tj ) 2 ] 3/2 
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where 


(fb + /a) 2 * 

V fb -fa ’ 1 fb +/. 

A and / 0 being the upper and lower cut-off frequencies. 

5. In section 3.5 several multiple integrals which occur in the work of 
Part III are discussed. 

6. The distribution of the maxima of /(/) is discussed in section 3.6. The 
expected number of maxima per second is 




(3.6-6) 


For a band-pass filter the expected number of maxima per second is 

f3 f b - /n i/2 

L5 ft - fj 


(3.6-7) 


For a low-pass filter where f a = 0 this number is 0.775 fb . 

The expected number of maxima per second lying above the line /(/) = h 
is approximately, when h is large, 

e ~i\iHo y, i[the expected number of zeros of / per second] (3.6-11) 


where \po is the mean square value of /(/). 

For a low-pass filter the probability that a maximum chosen at random 
from the universe of maxima lies between I and I + d.1 is approximately, 
when / is large, 



(3.6-9) 


where 



7. When we pass noise through a relatively narrow band-pass filter one 
of the most noticeable features of an oscillogram of the output current is 
its fluctuating envelope. In sections 3.7 and 3.8 some statistical properties 
of this envelope, denoted by R or R(t), are derived. 

The probability that the envelope lies between R and R -j- dR is 


R e -R>,2*o dR 

VO 


(3.7-10) 
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where to is the mean square value of /(/). The probability that R(t) lies 
between Ri and R\ -f- dR\ and at the same time R(t -f r) lies between 
Ri and Ri -f- dR 2 when t is chosen at random is obtained by multiplying 
(3.7-13) by dRi dR« . For an ideal band-pass filter, the expected number 
of maxima of the envelope in one second is 

•64110 (f b fa) (3.8-15) 

When R is large, say y > 2.5 where 

R 1/2 

y = 7i72, to = r.m.s value of /(/), 
to 


the probability that a maximum of the envelope, selected at random from 
the universe of such maxima, lies between R and R -f dR is approximately 


1.13(y 2 - \)e - y7 ‘ 2 


dR 

to 2 


A curve for the corresponding probability density is shown for the range 
0 < y < 4. Curves which compare the distribution function of the maxima 
of R with other distribution functions of the same type are also given. 

8. In section 3.9 some information is given regarding the statistical 
behavior of the random variable: 

/ O+r 

l\t)dt (3.9-1) 

-i 

where h is chosen at random and /(/) is a noise current with the power 
spectrum w(f) and the correlation function t ( T )• The average value 
m T of E is Tto and its standard deviation a T is given by (3.9-9). For a 
relatively narrow band-pass filter 


( Tt _ 1 _ 

m r VT(f b - f a ) 

when T(Jb — f a ) » 1. This follows from equation (3.9-10). An ex¬ 
pression which is believed to approximate the distribution of E is given bv 
(3.9-20). 6 ^ 

9. In section 3.10 the distribution of a noise current plus one or more 

sinusoidal currents is discussed. For example, if I consists of two sine waves 
plus noise: 


1 = P cos pt + Q cos qt + I N , (3.10-20) 

where p and q are incommensurable and the r.m.s. value of the noise cur¬ 
rent /„ is \p a , the probability density of the envelope R is 

R i r M R r)Jo(Pr)Jo(Qr)e~' l " ,r * 12 dr (3.10-21) 

where / 0 ( ) is a Bessel function. 
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Curves showing the probability density and distribution function of R , 
when <2 = 0, for various ratios of P/r.m.s. I N are given. 

10. In section 3.11 it is pointed out that the representations (2.8-1) 
and (2.8-6) of the noise current as the sum of a great number of sinusoidal 
components are not the only ones which may be used in deriving the results 
given in the preceding sections of Part III. The shot effect representation 

j QQ 

/«'= g F(l - t k ) 

studied in Part I may also be used. 


Part IV—Noise Through Non-Linear Devices 

1. Suppose that the power spectrum of the voltage V applied to the 
square-law device 

/ = cxV 2 (4.1-1) 

is confined to a relatively narrow band. The total low-frequency output 
current I t l may be expressed as the sum 

III = Ide + /// (4.1-2) 

where Idc is the d.c. component and I( f is the variable component. When 
none of the low-frequency band is eliminated (by audio frequency filters) 

la = (4.1-6) 


where R is the envelope of V. If V is of the form 

V = V N 4- P cos pt -f- Q cos qt , 


(4.1-4) 


where V N is a noise voltage whose mean square value is rpo , then 

# it 2 

Id, 


P 2 O 

*0+ y+ f 


4 



fc = a 

*1 4" P 2 1 o 4- Q 2 yp o 4- — 


2. If instead of a square-law device we have a linear rectifier, 


/ = 


0 

"V, 


V 

V 


0 

0 


the total low'-frequencv output is 


(4.1-16) 


(4.2-1) 


hi = 


olR 


10 


(4.2-2) 
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When V is a sine wave plus noise, V N + P cos pt , 


Idc = “(li) 1 » ~ X ^ 

(4.2-3) 

fit = — 2 (F 2 4“ 2^o) 

(4.2-6) 

where \F\ is a h^pergeometric function and 


_ P 2 _ Ave. sine wave power 

2\po Ave. noise power 

(4.2-4) 

When x is large 



(4.2-7) 


If V consists of two sine waves plus noise, / dc consists of a hypergeometric 
function of two variables. The equations running from (4.2-9) to (4.2-15) 
are concerned with this case. About the only simple equation is 

l]( = — [2^o + P 2 + Q 2 ] (4.2-14) 

3. The expressions (4.1-6) and (4.2-2) for I tl in terms of the envelope 
R of V , namely 

<*R 2 , aR 

— and —, 

7T 

are special cases of a more general result 

Id = A 0 (R) = ~ F(iu)J 0 (uR) du. (4.3-11) 

In this expression J 0 (uR) is a Bessel function. The path of integration C 

and the function F(iu) are chosen so that the relation between I and V mav 
be expressed as y 



(4A-1) 


A table giving F{iu) and C for a number of common non-linear devices is 
shown in Appendix 4A. cs 1S 

If this relation is used to study the biased linear rectifier. 


I = 


0 , 

V - B, 
11 


V < B 

V > B 


(4.3-17) 
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for the case in which V is V K + P cos pt, we find 



B , P B 2 + l o 

2 ir 2 tP 





P 2 - B 2 
7T 2 P* 



when P » | B | , P 2 » i/'o where is the mean square value of V N . 

4. When 1 is confined to a relatively narrow band and there are no 
audio-frequency filters, the probability density and all the associated sta¬ 
tistical properties of Iu may be obtained by expressing as a function 
of the envelope R of 1’ and then using the probability density of R. When 
\ is 1 A --+- P cos pt + Q cos qt this probability density is given by the in¬ 
tegral, (3.10-21) (which is the integral containing three Bessel functions 
stated in the above summary of Part III). WTien V consists of three sine 
waves plus_noise there are four Jo s in the integrand, and so on. Expres¬ 
sions for R n when R has the above distribution are given by equations 

(3.10-25) and (3.10-27). 

WTien audio-frequency filters remove part of the low-frequency band the 
statistical properties, except the mean square value, of the resulting cur¬ 
rent are hard to compute. In section 4.3 it is shown that as the output band 
is chosen narrower and narrower, the statistical properties of the output 
current approach those of a random noise current. 

5. The sections in Part IV from 4.4 onward are concerned with the 
problem: Given a non-linear device and an input voltage consisting of noise 
alone or of a signal plus noise. What is the power spectrum of the output? 
A survey of the methods available for the solution of this problem is given 
in section 4.4. 

6. When a noise voltage V N with the power spectrum w(f) is applied to 
the square-law device 

I = aV 2 (4.1-1) 


the power spectrum of the output current I is, when / 0, 

/ +» 

w(x)w(J — x) dx (4.5-5) 

00 

where w{—x) is defined to equal w(x). The power spectrum of I when V 
is either P cos pt -f- V N or 

Q( 1 + £ cos pt) cos qt + V N 

is considered in the portion of section 4.5 containing equations (4.5-10) to 
(4.5-17). 
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7. A method discovered independently by Van Vleck and North shows 
that the correlation function Sl'(r) of the output current for an unbiased 
linear rectifier is 

* (t) = T + £ !F, [ -i ’ (4 ' 7_6) 

where die input voltage is \\ . The correlation function \p(r) of V N is 
denoted by \p T and the mean square value of T* is p 0 . The power spectrum 
IF( f) of I may be obtained from 

W(f) = 4 [ 'J'(r) cos 2 t rfr dr (4.6-1) 

Jo 

by expanding the hypergeometric function and integrating termwise using 

Gn(f) = f cos 2tt/t dr. (4C-1) 

Jo 

Appendix 4C is devoted to the problem of evaluating the integral for G n (J ). 

8. Another method of obtaining the correlation function \p(r) of /, termed 
the “characteristic function method,” is explained in section 4.8. It is 
illustrated in section 4.9 where formulas for ^(r) and W(f) are developed 
when the voltage P cos pt + V N is applied to a general non-linear device. 

9. Several miscellaneous results are given in section 4.10. The char¬ 
acteristic function method is used to obtain die correlation function for a 
square-law device. The general formulas of section 4.9 are applied to the 
case of a v ih law rectifier when the input noise spectrum has a normal law 
distribution. Some remarks are also made concerning the audio-frequency 
output of a linear rectifier when the input voltage V is 

<2(1 + r cos pt) cos qt -f V N . 

10. A discussion of the hypergeometric function iFi(a; c; x), which often 
occurs in problems concerning a sine wave plus noise, is given in 
Appendix 4B. 


PART I 

THE SHOT EFFECT 

The shot effect in vacuum tubes is a typical example of noise. It is due 
to fluctuations in the intensity of the stream of electrons flowing from the 
cathode to the anode. Here we analyze a simplified form of the shot effect. 
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1.1 The Probability of Exactly K Electrons Arriving at the 

Anode in Time T 

The fluctuations in the electron stream are supposed to be random. We 
shall treat this randomness as follows. We count the number of electrons 
flowing in a long interval of time T measured in seconds. Suppose there 
are A,. Repeating this counting process for many intervals all of length 
gives a set of numbers A' 2 , K z • • • K„ where M is the total number of 
intervals. The average number v, of electrons per second is defined as 


v = Lim K ' + K *+ • • • + A v 

v -*oo MT 


(i.i-D 


where we assume that this limit exists. As M is increased with T being 
held fixed some of the K’s will have the same value. In fact, as M increases 
e number of K’s having any particular value will tend to increase. This 
of course is based on the assumption that the electron stream is a steady 

flow upon which random fluctuations are superposed. The probability of 
getting K electrons in a given trial is defined as 


p(K) = Lim - Number °f trials giving exactly K elect rons 

M —*oo ~M " (1.1-/I 

Of course p(K) also depends upon T. We assume that the random¬ 
ness of the electron stream is such than the probability that an electron 
will arrive at the anode in the interval (l, t + At) is vAt where At is 
such that vAt « 1, and that this probability is independent of what has 
happened before time t or will happen after time t -f- At. 

This assumption is sufficient to determine the expression for p(K) which is 

PUO = (Jgf O.f-3) 

This is the “law of small probabilities ,, given by Poisson. One method 
of derivation sometimes used can be readily illustrated for the case K = 0. 

Thus, divide the interval, (0, T) into M intervals each of length At = — . 

At is taken so small that vAi is much less than unity. (This is the “small 
probability” that an electron will arrive in the interval At). The prob¬ 
ability that an electron will not arrive in the first sub-interval is (1 — vAi). 
The probabihty that one will not arrive in either the first or the second 
sub-interval is (1 — vAt ) 2 . The probability that an electron will not arrive 

m any of the M intervals is (1 - vAt)". Replacing M by T/At and letting 
At —> 0 gives 

P( 0) = 

14 
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The expressions for />( 1), p{ 2), ••• />( AT) may be derived in a somewhat 
similar fashion. 


1.2 Statement of Campbell’s Theorem 

Suppose that the arrival of an electron at the anode at time / = 0 produces 
an effect F(t) at some point in the output circuit. If the output circuit 
is such that the effects of the various electrons add linearly, the total effect 
at time t due to all the electrons is 

+ao 

W) = Z Fit ~ Ik) (1.2-1) 

/c=- —00 

where the k xh electron arrives at and the series is assumed to converge. 

«) 

Campbell’s theorem* states that the average value of lit) is 

/(/) = v £ F(t) dt (1.2-2) 

and the mean square value of the fluctuation about this average is 

(7(0 “ 1(f)) 2 = * f + F\t)dt (1.2-3) 

J—oO 

where v is the average number of electrons arriving per second. 

The statement of the theorem is not precise until we define what we mean 
by “average”. From the form of the equations the reader might be tempted 
to think of a time average; e.g. the value 

T 

Lim i f I(t) dt (1.2-4) 

r—oo 1 Jo 

However, in the proof of the theorem the average is generally taken over 
a great many intervals of length T with / held constant. The process is 
somewhat similar to that employed in (1.1) and in order to make it clear 
we take the case of I(t) for illustration. We observe I(t) for many, say M , 
intervals each of length T where T is large in comparison with the interval 
over which the effect F(t) of the arrival of a single electron is appreciable. 
Let n I(t') be the value of /(/), /' seconds after the beginning of the n th in¬ 
terval. t’ is equal to t plus a constant depending upon the beginning time 
of the interval. We put the subscript in front because we wish to reserve 
the usual place for another subscript later on. The value of /(/') is then 
defined as 


/(/') = Limit i [,/(/') + J(t') + • • • + M I(t')] (1.2-5) 


and this limit is assumed to exist. The mean square value of the fluctua¬ 
tion of 1(F) is defined in much the same way. 


hv 'r (1 ^>L?, 17 .- 136 ’ 31 °- 32 8- Ch" P^of is similar to one given 

by J. M. Whittaker, Proc. Canib. Phil. Soc. 33 (1937), 451-458. 6 
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Actually, as the equations (1.2-2) and (1.2-3) of Campbell’s theorem 
slow, these averages and all the similar averages encountered later turn 
out to be independent of the time. When this is true and when the M in¬ 
tervals in (1.2-5) are taken consecutively the time average (1.2-4) and the 

a\ erage (1.2-5) become the same. To show this we multiply both sides of 
(1.2-5) by dt' and integrate from 0 to T: 



Limit 

A/ —♦oo 


Limit 

M —*00 


l 

MT 

1 

MT 



(1.2-6) 


and this is the same as the time average (1.2-4) if the latter limit exists. 


1.3 Proof of Campbell’s Theorem 

Consider the case in which exactly K electrons arrive at the anode in an 
interval of length T. Before the interval starts, we think of these K elec¬ 
trons as fated to arrive in the interval (0, T) but any particular electron is 
just as likely to arrive at one time as any other time. We shall number 
these fated electrons from one to K for purposes of identification but it is to 
be emphasized that the numbering has nothing to do with the order of ar¬ 
rival. Thus, if 4 be the time of arrival of electron number k, the probability 
that 4 lies in the interval (/, t + dt) is dt/T. 

We take T to be very large compared with the range of values of t for 

which F(t) is appreciably different from zero. In physical applications 

such a range usually exists and we shall call it A even though it is not very 

definite. Then, when exactly K electrons arrive in the interval (0, T) the 
effect is approximately 

K 

= Y, F(t - 4 ) (1.3-1) 

Ar-1 7 


the degree of approximation being very good over all of the interval except 
within A of the end points. 

Suppose we examine a large number M of intervals of length T. The 
number having exactly K arrivals will be, to a first approximation M p(K) 
where p{K) is given by (1.1-3). For a fixed value of t and for each interval 
having A arrivals, /*(/) will have a definite value. As M —-> oc f the average 
value of the I *(/)’s, obtained by averaging over the intervals, is 



= t f y F (t ~ &> 


(1.3-2) 


16 


149 


and if A < / < T — A, vve have effectively 



(1.3-3) 


If we now average I{t) over all of the M intervals instead of only over 
those having K arrivals, we get, as M —» x y 


00 


I«) = E P(K)I K {t) 

K -0 



(1.3-4) 


and this proves the first part of the theorem. We have used this rather 
elaborate proof to prove the relatively simple (1.3-4) in order to illustrate a 
method which may be used to prove more complicated results. Of course, 
(1.3-4) could be established by noting that the integral is the average value 
of the effect produced by one arrival, the average being taken over one 
second, and that v is the average number of arrivals per second. 

In order to prove the second part, (1.2-3) of Campbell’s theorem we first 
compute / 2 (/) and use 

(/(/) - ijt)) 2 = PU) - 2 J(/)7(0 + l(tf 

= /*W - Wf (1.3-5) 

From the definition (1.3-1) of /*(/), 

ri(0 = - 4 )F(t - u) 

k— 1 msrn 1 

Averaging this over all values of 4,4, ■■■ U with t held fixed as in (1.3-2), 

^-tt Cy-L’t ™ ~ w ~ '■) 

Ihe multiple integral has two different values. If k = m its value is 

r - <•) f 

and if k ^ in its value is 

jf FU - « r C t 
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Counting up the number of terms in the double sum shows that there are K 

of them having the first value and K 2 —K having the second value. Hence, 
it A < / < T — A we have 

- f iy m * + m [£■, w „j 

Averaging over all the intervals instead of only those having A' arrivals 
gives ** 


00 


m = Z /iw 


A-0 


Z +OO 

^(0 dt + JJfy 

oo 

where the summation with respect toK is performed as in (1.3-4), and after 
summation the value (1.3-4) for I(t) is used. Comparison with (1.3-5) 
establishes the second part of Campbell’s theorem. 


1.4 The Distribution of I(t) 

When certain conditions are satisfied the proportion of time which /(/) 

spends in the range I, I + dl is P{I)dI where, as » - », the probability 
density P(I) approaches 


—-— -(/-/) 2 /2^2 
*iV2i e 


(1.4-1) 


where / is the average of /(/) given by (1.2-2) and the square of the standard 
deviation <r 7 , i.e. the variance of /(/), is given by (1.2-3). This normal 
distribution is the one which would be expected by virtue of the “central 
limit theorem” in probability. This states that, under suitable conditions, 
the distribution of the sum of a large number of random variables tends 
toward a normal distribution whose variance is the sum of the variances 
of the individual variables. Similarly the average of the normal distribu¬ 
tion is the sum of the averages of the individual variables. 

So far, we have been speaking of the limiting form of the probability 
density P(/). It is possible to write down an explicit expression for P(/), 
which, however, is quite involved. From this expression the limiting form 
may be obtained. We now obtain this expression. In line with the dis¬ 
cussion given of Campbell’s theorem, we seek the probability density P{I) 
of the values of I(t) observed at t seconds from the beginning of each of 
large number, M, of intervals, each of length T. 
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Probability that /(/) lies in range (/, I -f dl) 

00 

= 23 (Probability of exactly K arrivals) X 

A' — O 

(Probability that if there are exactly 
K arrivals, I K (t) lies in (/, I -f dl)). 

Denoting the last probability in the summation by P K (I)dI , using notation 
introduced earlier, and cancelling out the factor dl gives 

P(I) = E P(K)P k (I) (1.4-2) 

A'-O 

We shall compute P K U) by the method of “characteristic functions” 3 from 
the definition 


K 

r*( 0 = E - 4) (1.3-1) 

of I K (t). The method will be used in its simplest form: the probability that 
the sum 


Xi -f- *2 -r • • • x K 

of K independent random variables lies between X and X + dX is 

dX — [ e~' Xu XJ (average value of e' xku ) du 

Z7T J—tt A:- 1 


00 
XZLU 


(1.4-3) 


The average value of e , i.e., the characteristic function of the distribution 

of x k , is obtained by averaging over the values of x k . Although this is the 

simplest form of the method it is also the least general in that the integral 

does not converge for some important cases. The distribution which gives 

a probability of ^ that x k = — 1 and \ that x k = +1 is an example of such a 

case. However, we may still use (1.4-3) formally in such cases by employ- 
ing the relation 


/ e~ tau du = 2tt5 (a) 

J—00 


(1.4-4) 

where 5(a) is zero except at a = 0 where it is infinite and its integral from 
a ~ c to a. = -feis unity where € > 0. 

, When we identify x k with F(t - t k ) we see that the average value of 

€ IS 


1 f T 

- I exp [iuF{t - t k )] dt, 


f pp r 369 ar 3 k 9 S 2° n SS 
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All of the K characteristic functions are the same and hence, from (1 4-3) 
P K (I)dI is V 




exp [iuF{t — 



Although in deriving this relation we have taken K > 0, it also holds for 

A' = 0 (provided we use (1.4-4)). In this case P„(7) = 6(1), because 7 = 0 
when no electrons arrive. 

Inserting our expression for P K (I) and the expression (1.1-3) for p(K) 
in (1.4-2) and performing the summation gives 



The first exponential may be simplified somewhat. Using 


(1.4-5) 



permits us to write 


~vT + v [ exp [iuF(t - r)] dr = v f (exp \iuF(t - r)] - 1) dr 

•'O Jq 

Suppose that A < t < T — A where A is the range discussed in connection 
with equation (1.3-1). Taking | F(t - r ) | = 0 for 1 1 - r | > A then 
enables us to write the last expression as 

, r° - 1] dl (1.4-6) 

•*—00 

Placing this in (1.4-5) yields the required expression for P{I): 

p V) = exp (^-ilu + * J_ [e iuP(n - 1 ]dt)jdu (1.4-7) 


An idea of the conditions under which the normal law (1.4-1) is ap¬ 
proached may be obtained from (1.4-7) by expanding (1.4-6) in powers of 
u and determining when the terms involving u and higher powers of u 
may be neglected. This is taken up for a slightly more general form of 
current in section 1.6. 
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1.5 Extension of Campbell’s Theorem 

In section 1.2 we have stated Campbell’s theorem. Here we shall give 
an extension of it. In [dace of the expression (1.2-1) for the lit) of the shot 
effect we shall deal with the current 

Hf) = Z a k F(t - t k ) (1.5-1) 

— oo 

where F(t) is the same sort of function as before and where • • • a\ , a 2 , • • * 
ak , • • • are independent random variables all having tlie same distribution. 
It is assumed that all of the moments a n exist, and that the events occur at 
random 

The extension states that the wth semi-invariant of the probability density 
P(I) of 7, where 7 is given by (1.5-1), is 

A„ = va™ f {F(t)] n c1t (1.5-2) 

J— oo 

where v is the expected number of events per second. The semi-invariants 
of a distribution are defined as the coefficients in the expansion 

log, (ave. «"“) = £ («)" + o(« w ) (1.5-3) 

n«l til 

i.e. as the coefficients in the expansion of the logarithm of the characteristic 
function. The A’s are related to the moments of the distribution. Thus if 
) W 2 , • • • denote the first, second • • • moments about zero we have 

ave. e i,u = 1 + E —" {iu) n + o{u N ) 

n= 1 n\ 

By combining this relation with the one defining the A’s it may be shown that 

I = mi = Ai 

/ 2 = wi2 = Ao -\- \\trii 

/ 3 = viz = A3 T 2A2W1 T A1W2 


It follows that Ai = / and A 2 = ave. (7 — if. Hence (1.5-2) yields the 
original statement of Campbell’s theorem when we set n equal to one and 
two and also take all the a’s to be unity. 

The extension follows almost at once from the generalization of expression 
(1.4-7) for the probability density F(I). By proceeding as in section 1 4 
and identifying x k with a k F(t - t k ) we see that 


ave. e 


txfcu 



r T 

exp [iuaF(t — 4 )] dt k 

Jo 
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where g(a) is the probability density function for the <z’s. It turns out that 
the probability density P(I) of I as defined by (1.5-1) is 

1 r + °° / /.+« 

= exp ( —ilu + v I q(a) da 




(1.5-4) 


I he logarithm of the characteristic function of P(l) is, from (1.5-4), 


/ +°° /• 

q(a) da / [ e { 

00 JLoo 




- 1 \dt 





Comparison vvitli the series (1.5-3) defining the semi-invariants gives the 
extension of Campbell's theorem stated by (1.5-2). 

Other extensions of Campbell's theorem may be made. For example, 
suppose in the expression (1.5-1) for /(/) that t \, t 2 , • • * , • • • while still 

random variables, are no longer necessarily distributed according to the 
laws assumed above. Suppose now that the probability density p(x) is 
given where x is the interval between two successive events: 


/ 2 = /i + (1.5-5) 

h = h + X2 = t\ + Xi + X2 

and so on. For the case treated above 

p( x ) = (1.5-6) 

We assume that the expected number of events per second is still v. 

Also we take the special, but important, case for which 

F(t) = 0, t < 0 (1.5-7) 

F{t) = / > 0. 

For a very long interval extending from / = t x to t = T + t i inside of which 
there are exactly K events we have, if t is not near the ends of the interval, 

/(/) = a\F(t — t \) -f- a 2 F(t — t\ — #i) -{-••• 


+ OK+iF(t — t\ — x\ • * * — Xk) 

— a\F(t') -f- aiFit' — ,ri) + — + a K +\F(t' — .ri — — — x K ) 
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r(t) = a 2 F 2 (F) + a\F*(F — *0 + • • * + — *!••• — x K ) 

+ 2aiaiF(t')F{t' — # 1 ) + • * * + 2a\a k+iF (F) F (F — x\ • ♦ • — xg) 

~b 2a 2 aiF(F — x\)F{F — .ri — + • * * + * * • 

where F = t — 1 1. If we integrate l\t) over the entire interval 0 < F < T 
and drop the primes we get approximately 

f I 2 (t)dt = (a\ + • * • + a 2 K +\)<p(Q) 

JQ 


-f 2 a\d 2 ff(xi) + 2a\a$f{x\ + x 2 ) • • • -f- 2aia K ^{ Xl + •.. -f Xk ) 

-f 2a 2 a*p(x 2 ) 4 - ... -f 2a K a K +i<?(x k) 


where 


/ +« 

F{t)F(t — x) dt 

QO 

When we divide both sides by T and consider K and T to be very large, 


Kal + 

f 


. 2 
“T a K+ \ 


K 


— ^(0) = va 2 ip( 0) 


T [aia 2 <p(xi) + a*a z <p(x 2 ) + •■• + a K a K +i<p(x K )] = ^average a k a^ l(fi (x k ) 

= va / <p(x)p(x) dx 

Jo 

f [a ' a *^ x '- + *») + • • 'I = ave. a* <!*.«*(** + * t+1 ) 


= "“l dx i J dxtPWplxtMxt + *,) 


Consequently 


T 

m = Lim if / 2 (0 

r-»oo 1 Jo 


dt 


= vaV(O) + 2 


-2 


va 



/>(*)<^(*) dx 


+ L dXl l dx *P(*dP(x*)<p(xi 


+ *2) + 


• • * 


I or our special exponential form (1.5-7) for F(/), 


<?(*) = 


—ax 


2a 
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and the multiple integrals occurring in the expression for I 2 (t) may be written 
in terms of powers of 





(1.5-8) 


Thus 


and since 


we have 


2 aP{t) = m* + 2a v — 

1 - q 



m - m- - g + (")’[kt^ 7) - ‘] a ' s - 9) 

Equations (1.5-8) and (1.5-9) give us an extension of Campbell’s theorem 
subject to the restrictions discussed in connection with equations (1.5-5) 
and (1.5-7). Other generalizations have been made 4 but we shall leave the 
subject here. The reader may find it interesting to verify that (1.5-9) 
gives the correct answer when p(x) is given by (1.5-6), and also to investi¬ 
gate the case when the events are spaced.equally. 


1.6 Approach of Distribution of / to a Normal Law 


In section 1.5 we saw that the probability density P(I) of the noise current 
I may be expressed formally as 


+ » 


P (/) = 2- f exp -Hu + ± ( iu)"\ 

Z 7T J— oo — n = 1 



du (1.6-1) 


where X n is the wth semi-invariant given by (1.5-2). By setting 


= a 



(1.6-2) 


4 See E. N. Rowland, Proc. Camb. Phil. Soc. 32 (1936), 580-597. He extends the 
theorem to the case where there are two functions instead of a single one, which we here 
denote by /(/)• According to a review in the Zentralblatt fUr Math., 19, p. 224, Khint- 
chine in the Bull. Acad. Sci. URSS, ser. Math. Nr. 3 (1938), 313-322, has continued and 
made precise the earlier work of Rowland. 
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expanding 


oo 


ex P 2 ( iu) n \ n /n\ 


n=3 


as a power series in «, integrating termwise using 


~f 

2tt L 




oc 


(iua) 


r • , „ 

exp I — tuax - - - \du = (-)" 

(n) / \ 1 ^ — j-2 /9 

* W *V5 i?* 


— 1 ( n ) 

(7 s ? 


(*), 


and finally collecting terms according to their order i 


in powers of u 1,2 } gives 


/>(/) 


Xa a 


-4 


— 1 10) / \ A3 *J 13 i 

(7 (x) 


3F V W + 


hrr* 


(*) + X ^f2~ * * + ■ • • 


(1.6-3) 

The first term is 0(>< _1/2 ), the second term is 0( v ~\ and the term within 

brackets ,s 0(„ ). This is Edgeworth’s series. 6 The first term gives the 

normal distribution and the remaining terms show how this distribution is 
approached as v —» oc . 

1.7 The Courier Components of /(/) 

In some analytical work noise current is represented as 


m * ? + (« 


cos 


27 mt 

T 


+ b n sin 


2imt\ 

T 


(1.7-1) 


where at a suitable place in the work T and .V are allowed to become infinite 

The coefficients :a n and b. , 1 <n< X, are regarded as independent random 
variables distributed about zero according to a normal law 

It appears that the association of (1.7-1) with a sequence of disturbances 

that H n 8 k at K ra , ° m , g0eS many y6arS - Ra - Vle ‘« h6 and Gouy suggested 
that black-body radiation and white light might both be regarded as se¬ 
quences ^irregularly distributed impulses. 

coefficient" in a 7 V n d ’ SCUSSed the normal distribution of the 

F °" b “ ne ,h ' by . gr... many L.penTn't 

" d Di-Mbatta.” 

Phd. Mag. Ser 5, Vol. 27 (1889) pp. 460^469. 

v n j tem ^ L '^ I « pf ’ Ann ’ d ■ Ph ysik 33 (1910) pp 1095-m s 
M. V. Laue, Ann. d. Physik 47 (1915) pp. 853-878 PP ' ll0 ' 

?} n ! tein » A . nn - d . p hysik 47 (1915) pp. 879-885 ' 

V- . 4 nn d - Physik 48 (1915) pp. 668-680 
I am indebted to Prof. Goudsmit for these references. 
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cillators. Some argument arose as to whether the coefficients in (1.7-1) 

were statistically independent or not. It was finally decided that they 
are independent. 

The shot effect current has been represented in this way by Schottky. 8 
The Fourier series representation has been discussed by H. Nyquist 9 and 
also by Goudsmit and Weiss. Remarks made by A. Schuster 10 are equiv¬ 
alent to the statement that and b n are distributed normally. 

In view of this wealth of information on the subject it may appear super- 
lluous to say anything about it. However, for the sake of completeness, 
we shall outline the thoughts which lead to (1.7-1). 

In line with our usual approach to the shot effect, we suppose that exactly 

A electrons arrive during the interval (0, T) t so that the noise current for 
the interval is 


K 

Ix(t) = Z F(t - he) (1.7-2) 

<t=l 7 


The coefficients in the Fourier series expansion of /*(/) over the interval 
(0, T) are a nK and b nK where 


amt ibrxR — — 2 ^ F{t — 4) exp £ — i 

-t&L. m exp [ -i 2 ~t {l + 4) ] dt 

= R n e~'*" Z e - ine ' (1.7-3) 

In this expression 



2irt k 

T 



F{t)e~ i2rnt,T dt 



(1.7-4) 


In the earlier sections the arrival times h , / 2 , • • • t K were regarded as K 
independent random variable each distributed uniformly over the interval 
(O, T). Hence the 0 k s may be regarded as random variables distributed 
uniformly over the interval 0 to 2ir. 

Incidentally, it will be noted that in (1.7—3) there occurs the sum of K 
randomly oriented unit vectors. When K becomes very large, as it does 

8 Ann. d. Physik, 57 (1918) pp. 541-567. 

9 Unpublished Memorandum, “Fluctuations in Vacuum Tube Noise and the Like,” 
March 17, 1932. 

10 Investigation of Hidden Periodicities, Terrestrial Magnetism, 3 (1898), pp. 13-41. 
See especially propositions 1 and 2 on page 26 of Schuster’s paper. 
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when v —> go f it is known that the real and imaginary parts of this sum are 
random variables, which tend to become independent and normally dis¬ 
tributed about zero. This suggests the manner in which the normal dis¬ 
tribution of the coefficients arises. Averaging over the 0*’s in (1.7-3) gives 
when n > 0 



Some further algebra gives 

~2 ,2 

CL nK Un A 



(InK 



CL n K U m K 



( 1.7-5) 


(1.7-6) 


where n m and n, m > 0. 

So far, we have been considering the case of exactly A arrivals in our 
interval of length T. Xow we pass to the general case of any number of 
arrivals by making use of formulas analogous to 

_ oo 

al = y p(K)a\ K (1.7-7) 

as has been done in section 1.3. Thus, for n > 0, 


d n 

= K = 

0 



O 

a'n 

= = 

vT K- 

T R " 

= <Tn 

(1.7-8) 

CL r\ b n 

CLrx CLrr\ 

II 

= o, 

n 9 ^ m 


In the second line we have used or n to denote the standard deviation of a n 

and b n . We may put the expression for cr~ n in a somewhat different form 
by writing 



(1.7-9) 


where/„ is the frequency of the nth component. Using (1.7-4), 




F(l)e~ i2rfnt 



(1.7-10) 


Thus, (7 n is proportional to v/T. 

The probability density function P ( ai , • • • a N , 6,, • •. b N ) for the 2 N co¬ 
efficients, ai , • • • a N , bi , • ■- b N may be derived in much the same fashion 
as was the probability density of the noise current in section 1.4. Here N 
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is arbitrary but fixed. The expression analogous to (1.4-5) is the 2N fold 
integral 


where 




U.7-11) 


exp [-i(ai«, + ... + b N v N ) - vT + vTE ] 


1 r 2 ' f n 

^ ~ 2w Jo ^ ex P p E ( M » C n + v„S„) cos nd + (v n C„ — u„ S„) sin nd 

(1.7-12) 

in which C n - iS n is defined as the Fourier transform (1.7-1) of F(t). 

The next step is to show that (1.7-11) approaches a normal law in 2N di¬ 
mensions as v —> ». This appears to be quite involved. It will be noted 

that the integrand in the integral defining E is composed of N factors of the 
form 


exp [ip n cos (nd — \/y n )] 

= ^o(pn) + 2 i cos (ne — \!/n)J\(p n ) 

where 

Pn = (Un + /n)(C 2 n + S\) 

As v becomes large, it turns out that the integral (1.7-11) for the prob¬ 
ability density obtains most of its contributions from small values of u and v. 

By substituting the product of the Bessel function series in the integral for 
E and integrating we find 

S 

E = XT Jo(pn) + A + B + C 

n—1 

where A is the sum of products such as 

— 2i cos (\l/k+l — i pk — 'l'l)J\(pk)J\(pl)J\(pk+c) times N — 3 Jqs 

in which 0 < k < l and 2 < k + / < N. Similarly B is the sum of products 
of the form 


2 cos (2nd — 2i/' n )/ 2 (p n ) + 


• • 


2 2 / 2 , 2 \ 
^ <Tn(Hn + V n ). 


— 2i cos (\p 2 k — 2\f/ k )Ji(p2k)J2(pk) times N — 2 Jo s 

C consists of terms which give fourth and higher powers in u and v. There 
are roughly N 2 /4 terms of form A and N/2 terms of form B. 

Expanding the Bessel functions, neglecting all powers above the third and 
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proceeding as in section 1.4, will give us the normal distribution plus the first 
correction term. It is rather a messy affair. An idea of how it looks mav 
be obtained by taking the special case in which F(t) is an even function cf / 
and neglecting terms of type B. Then 


where 


T(<z, , 


V , , • • • M = (1 4 - rj) IT 


n = 1 




lira 


(1.7-12) 


a n 

Xn = — , 

<Jn 


y n = 


77 = (2 vT) 1 2 Y - y k y() + 2 y^fy k y(] (1.7-13) 

k.( 

and the summation extends over 2 < k + / < A' with k < l. 

It is seen that if T and X are held constant, the correction term 77 ap¬ 
proaches zero as v becomes very large. A very rough idea of the magnitude 
of 77 may be obtained by assuming that unity is a representative value of the 
.r’s and y’s. Further assuming that there are .V" terms in the summation 
each one of which may be positive or negative suggests that magnitude of 

the sum is of the order of X. Hence we might expect to find that 77 is of 
the order of X(2vT)~ m . 


PART II 

POWER SPECTRA AND CORRELATION FUNCTIONS 

2.0 Introduction 

A theory for analyzing functions of time, t, which do not die down and 
which remain finite as t approaches infinity has gradually been developed 
over the last sixty years. A few words of its history together with an ex¬ 
tensive bibliography are given by N. Wiener in his paper on ‘‘Generalized 
Harmonic Analysis”. 11 G. Gouy, Lord Rayleigh and A. Schuster were led 
to study this problem in their investigations of such things as white light 
and noise. Schuster 12 invented the “periodogram” method of analysis which 
has as its object the discovery of any periodicities hidden in a continuous 
curve representing meteorological or economic data. 

\p EteS SSSStX WfSftS-s? is 

13y and still later redefined it in “The Periodogram and its Optical \naloirv” IW' p° 7 ~ 
lent to Wn’ where ' PP ‘ 13<M40 ‘ In 

lion o? the^eriod r = Y 2 t/)-. he P °" er SPeCtrUm de6ned in SeCtion P^ted as a^unc- 
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The correlation function, which turns out to be a very useful tool, appar¬ 
ently was introduced by G. I. Taylor. 13 Recently it has been used by quite 
a few writers 14 in the mathematical theory of turbulence. 

In section 2.1 the power spectrum and correlation function of a specific 
function, such as one given by a curve extending to / = oo, are defined by 
equations (2.1—3) and (2.1-4) respectively. That they are related by the 
Fourier inversion formulae (2.1-5) and (2.1-6) is merely stated; the dis¬ 
cussion of the method of proof being delayed until sections 2.3 and 2.4. In 
section 2.3 a discussion based on Fourier series is given and in section 2.4 a 
parallel treatment starting with Parseval’s integral theorem is set forth. 
The results as given in section 2.1 have to be supplemented when the func¬ 
tion being analyzed contains a d.c. or periodic components. This is taken 
up in section 2.2. 

I he first four sections deal with the analysis of a specific function of /. 
However, most of the applications are made to functions which behave as 
though they are more or less random in character. In the mathematical 
analysis this randomness is introduced by assuming the function of t to be 
also a function of suitable parameters, and then letting these parameters be 
random variables. This question is taken up in section 2.5. In section 2.6 
the results of 2.5 are applied to determine the average power spectrum and 
the average correlation function of the shot effect current. The same thing 
is done in 2.7 for a fiat top wave, the tops (and bottoms) being of random 
length. The case in which the intervals are of equal length but the sign 
of the wave is random is also discussed in 2.7. The representation of the 
noise current as a trigonometrical series with random variable coefficients 
is taken up in 2.8. The last two sections 2.9 and 2.10 are devoted to prob¬ 
ability theory. The normal law and the central limit theorem, respectively, 
are discussed. 

2.1 Some Results of Generalized Harmonic Analysis 

We shall first state the results which we need, and then show that they are 
plausible by methods which are heuristic rather than rigorous. Suppose 
that /(/) is one of the functions mentioned above. We may think of it as 
being specified by a curve extending from t — — oo to t = oo. /(/) may 
be regarded as composed of a great number of sinusoidal components whose 
frequencies range from 0 to + 00 . It does not necessarily have to be a noise 
current, but if we think of it as such, then, in flowing through a resistance of 
one ohm it will dissipate a certain average amount of power, say p watts. 

13 Diffusion by Continuous Movements, Proc. Lond. Math. Soc., Ser. 2, 20, pp. 196- 
212 (1920). 

14 See the text “Modern Developments in Fluid Dynamics” edited by S. Goldstein, 
Oxford (1938). 
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That portion of p arising from the components having frequencies between 
/ and / -f df will be denoted by u'(f)df , and consequently 


= [ u'(f)df 


( 2 . 1 - 1 ) 


Since iv(f) is the spectrum of the average power we shall call it the “power 
spectrum’' of /(/). It has the dimensions of energy and on this account is 
frequently called the “energy-frequency spectrum” of /(/). A mathematical 
formulation of this discussion leads to a clear cut definition of ivif). 

Let $>(/) be a function of/, which is zero outside the interval 0 < t < T and 
is equal to /(/) inside the interval. Its spectrum Sif) is given by 


L 


dt 


( 2 . 1 - 2 ) 


The spectrum of the power, uif), is defined as 


v(f) = Limit - 

T 


00 


21 S(f) 
T 


(2.1-3) 


where we consider only values of / > 0 and assume that this limit exists. 

This is substantially the definition of w(f) given by J. R. Carson 15 and is 

useful when /(/) has no periodic terms and no d.c. component. In the 

latter case (2.1-3) must either be supplemented by additional definitions or 

else a somewhat different method of approach used. These questions will 
be discussed in section 2.2. 

The correlation function f{ T ) of /(/) is defined bv the limit 


T 

<Ht) = Limit i [ I{t)I(t + r) dt 

T —• oo 1 JQ 


(2.1-4) 


which is assumed to exist, ^(r) is closely related to the correlation coeffi¬ 
cients used in statistical theory to measure the correlation of two random 
variables. In the present case the value of /(/) at time / is one variable and 
its value at a different time / + r is the other variable. 

The spectrum of the power w(J) and the correlation function Mr) are 
related by the equations 


Mf) = 4 jf vKr) COS 2 7 t/t dr 

'P(t) = f w(f) cos 2t t/t df 


(2.1-5) 


w(f) cos 2 tt/t df (2.1-6) 

VOL 5 1 J, h pp St 3“ ^Energy ; Frequency Spectrum of Random Disturbances.” B.S.T.J., 
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It is seen that i//t) is an even function of t and that 


*(0) = P (2.1-7) 

When either \p(r) or iv(f) is known the other may be obtained provided the 
corresponding integral converges. 


2.2 Power Spectrum for D.C. and Periodic Components 


As mentioned in section 2.1, when /(/) has a d.c. or a periodic com¬ 
ponent the limit in the definition (2.1-3) for iv(f) does not exist for/equal 
to zero or to the frequency of the periodic component. Perhaps the most 

3 et ^ ^)f overcoming this difficulty, from the mathematical 

point of view, is to deal with the integral of the power spectrum. 16 



(2.2-1) 


instead of with iv(f) itself. 


The definition (2.1-4) for r p(r) still holds. If, for example, 


I(t) = A + C cos (27 t/o/ — p) 


\p(r) as given by (2.1-4) is 


iA(r) 


= A 2 + ^ cos 27r/or 


( 2 . 2 - 2 ) 

(2.2-3) 


The inversion formulas (2.1-5) and (2.1-6) give 

/ 


/ Mg) dg = - J Mr) Sm 2 lr f T dr 

Jo 7 T Jo T 

\p(r) = J cos 2tt/t d u: Mg) 


(2.2-4) 


16 This is done by Wiener, 11 loc. cit., and by G. \V. Kenrick, “The Analysis of Irregular 
Motions with Applications to the Energy Frequency Spectrum of Static and of Telegraph 
Signals,” Phil. Slag., Ser. 7, Yol. 7, pp. 176-196 (Jan. 1929). Kenrick appears to be one 
of the first to apply, to noise problems, the correlation function method of computing the 
power spectrum (one of his problems is discussed in Sec. 2.7). He bases his work on re¬ 
sults due to Wiener. Khintchine, in “Korrelationstheorie der stationaren stochastischen 
Prozesse,” Math. Antialen, 109 (1934), pp. 604-615, proves the following theorem: A 
necessary and sufhcient condition that a function R(t ) may be the correlation function of 
a continuous, stationary, stochastic process is that R(t ) may be expressed as 




cos tx dF(x) 


where F(x) is a certain distribution function. This expression for R(t) is essentially the 
second of equations (2.2-4). Khintchine’s work has been extended by H. Cramer, “On 
the theory of stationary random processes,” Ann. of Math., Ser. 2, Vol. 41 (1940), pp. 
215-230. However, Khintchine and Cramer appear to be interested primarily in ques¬ 
tions of existence, representation, etc., and do not stress the concept of the power spectrum. 
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where the last integral is to be regarded as a Stieltjes’ integral. When the 
expression (2.2-3) for t p(r) is placed in the first formula of (2.2-4) we get 


[ w(g)dg- | , 


2 ’ 


when 0 < / < / c 
“ f > fo 


(2.2-5) 


When this expression is used in the second formula of (2.2-4), the increments 
of the differential are seen to be A 2 at / = 0 and C 2 /2 at f = / 0 . The re¬ 
sulting expression for i//r) agrees with the original one. 

Here we desire to use a less rigorous, but more convenient, method of 
dealing with periodic components. By examining the integral of u{f) as 
given by (2.2-5) we are led to write 


w(f) = 2A 2 5(f) + j 5 (/ - /o) 
where <5(» is an even unit impulse function so that if 6 > 0 


( 2 . 2 - 6 ) 


[ 5(x) dx = \ f 5(x) dx = h 

Jo l J- ( 


(2.2-7) 


and 5(.\) 0 except at x — 0, where it is infinite. This enables us to use 

the simpler inversion formulas of section 2.1. The second of these, (2.1-6), 
is immediately seen to give the correct expression for \ P( T ). The first one, 

(2.1-5), gives the correct expression for w(f) provided we interpret the in¬ 
tegrals as follows: 


/ cos 2tt(t dr = \5( f) 

/ cos 2tt fo t cos 27rfr dr = \5( f — f 0 ) 

J(\ 


( 2 . 2 - 8 ) 


It is not hard to show that these are in agreement with the fundamental 
interpretation 


+ oc 


nw,, dt = r>' A = i( f) 

v— on 


which in its turn follows from a formal application of the I ; 
formula and 


(2.2-9) 


ourier integral 


+oc 


— OO 


5(/y w ' df = [ S(f)e~ i2r/ ‘df = 1 
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(2.2-101 


We must remember that /„ > 0 and / > 0 in (2.2-8) so that S(f + /„) = o 


1 66 


The definition (2.1-3) for u'(J) gives the continuous part of the power 
spectrum. In order to get the part due to the d.c. and periodic com¬ 
ponents, which is exemplified by the expression (2.2-6) for w(f) involving 
the <5 functions, we must supplement (2.1-3) by adding terms of the type 

2 A 2 5(f) + C j S(f - /„) = [Limit S (J) 

+ [Limit 21 ^{ 0) |2 ] S(f ~ fo ) 

The correctness of this expression may be verified by calculating S(f) for 
the /(/) of this section given by (2.2-2), and actually carrying out the limiting 
process. 


2.3 Discussion of Results of Section One—Fourier Series 


The fact that the spectrum of power w(J) and the correlation function 
i P(t) are related by Fourier inversion formulas is closely connected with 
Parseval’s theorems for Fourier series and integrals. In this section we shall 
not use Parseval’s theorems explicitly. We start with Fourier’s series and 
use the concept of each component dissipating its share of energy inde¬ 
pendently of the behavior of the other components. 

Let that portion of T(t) which lies in the interval 0 < / < T be expanded 
in the Fourier series 


m = a ; + 


±U, 

*=i \ 


2init , . 2imi\ 

cos —— -f- b n sin 


T ) 


(2.3-1) 


where 


2 f T 

a n = 77. / 1(0 cos 

1 Jo 

b. = \ [ m si 


2ixnt 


dt 


2iml . 
sm —dt 
T 


(2.3-2) 


Then for the interval — r < / < T — r, 

2irn(t + r) 


+ r) = a j + 


tu 

«-l \ 


cos 


T 


. , . 2irn (/ -f 

+ b n sin - 



(2.3-3) 


Multiplying the series for /(/) and /(/ 4- r) together and integrating with 
respect to / gives, after some reduction, 

T 

t f now + r> <u 

° ( 2 . 3 - 4 ) 

") 


2im 


= J + E l + *-) cos ~Y t+ °\T 


M 


16 ; 


where the last term represents correction terms which must be added be¬ 
cause the series (2.3-3) does not represent I(t + r) in the interval (T — t } T) 
when r > 0, or in the interval (0, — r) if r < 0. 

If lit) were a current and if it were to flow through one ohm for the in¬ 
terval (0, T), each component would dissipate a certain average amount 
of power. The average power dissipated by the component of frequency 
f n — n/T cycles per second would be, from the Fourier series and elementary 
principles, 



b\) watts, 


2 

0o 

4 


watts, 


n 0 

n = 0 


(2.3-5) 


The band width associated 
frequency between the n -f- 1 


with the nth component is the difference in 
th and nth components: 



n + 1 

~Y~ 


n 1 

T “ T CpS 


Hence if the average power in the band fyf+df is defined as w(J)df, the 
average power in the band /„+1 — /„ is 


»(/.)(/»+. -/o = 


and, from (2.3-5), this is given by 


w 


(r) t~ \ (a " 


w(0) ^ 

r 4 


+ b\). 


n ^ 0 


(2.3-6) 


n = 0 


When the coefficients in (2.3-4) are replaced by their expressions in terms 
of w(f) we get 


f jf nw + r )dt + o (zpj 


- f 5 * (?) 


COS 


27 mr 



T 

2imr dn 

~T~ Y 


r 

= / w 
Jo 

= / w(J) cos 2tt/t df 

Jo 


(2.3-7) 
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.vhere we have assumed T so large and w(f) of such a nature that the summa¬ 
tion may be replaced by integration. 

If I remains finite, then as T —» oo with r held fixed, the correction term 
on the left becomes negligibly small and we have, upon using the definitions 
(2.1-4) for the correlation function ^(r), the second of the fundamental 
inversion formulas (2.1-6). The first inversion formula may be obtained 
from this at once by using Fourier’s double integral for w(f). 

Incidentally, the relation (2.3-6) between w(J) and the coefficients a n and 
b n is in agreement with the definition (2.1-3) for w(f) as a limit involving 

\S(f)\ • From the expressions (2.3-2) for a n and b n , the spectrum £(/„) 
given by (2.1-2) is 


S(fn) = | (a n - ib n ) 

Then, from (2.1-3) w(f n ) is given by the limit, as T —> oo, 0 f 

f\S(fn)\ 2 = ^j(0 2 n +b* n ) 


— 2 + ^n) 


and this is the expression for w 



given by (2.3-6) 


2.4 Discussion of Results of Section One—Parseval’s Theorem 

The use of Parseval’s theorem 17 enables us to derive the results of section 
2.1 more directly than the method of the preceding section. This theorem 
states that 



Fi(/)F 2 (/) df 



Gi(/)G 2 (— t) dt 


where F\ y G\ and F 2 , Gi are Fourier mates related by 



G(t)e~ i2rft 




F(J)e <2r/t 



(2.4-1) 


(2.4-2) 


It may be proved in a formal manner by replacing the F\ on the left of 
(2.4-1) by its expression as an integral involving G](t). Interchanging the 


17 E. C. Titchmarsh, Introduction to the Theory of Fourier Integrals, Oxford (1937). 
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order of integration and using the second of (2.4-2) to replace F 2 by G 2 gives 
the right hand side. 

We now set G\(t ) and Go(t) equal to zero except for intervals of length T. 
These intervals and the corresponding values of G\ and Go are 

Gi(t) = /(/), 0 < t < T (2.4-3) 

C n {t) = /(-/ + r), t - T < t < r 

From (2.4-3) it follows that F\(f) is the spectrum S(f) of I(t) given by equa¬ 
tion (2.1-2). Since lit) is real it follows from the first of equations (2.4-2) 
that 


S(-f) = S*(f), (2.4-4) 

where the star denotes conjugate complex, and hence that | S(f) | 2 is an 
even function of /. 

The first of equations (2.4-2) also gives 


Fz(f) = f n-t + T)e iUn 

J t—T 


dt 


= f I (t)e <ir/u ~ T) 

Jn 


dt 


(2.4-5) 


= S*(J)e 


»2 r/r 


When these G' s and F' s are placed in (2.4-1) we obtain 

[ I S(f) | 2 e~ 2r/r< df = [ /(/)/(/ -f r) dt 

co JO 


(2.4-6) 


where we have made use of the fact that G 2 (-t) is zero except in the inter¬ 
val -t < t < T — t and have assumed r > 0. If r < 0 the limits of 
integration on the right would be — 7 and T. 

Since | S(f) | is an even function of / we may write (2.4-6) as 

f l I(l)I(i + t) dl + 0 (-f-) = l } 1 cos 2 *fr dj (2.4-7) 


If we now define the correlation function \p(r) as the limit, as T 
left hand side and define w{f) as the function 


«, of the 


w(f) = Limit 

T-* 00 


21 S(f) \ 2 


/ > 0 


(2.1-3) 


we obtain the second, (2.1-6), of the fundamental inversion formulas. As 
before, the first may be obtained from Fourier’s integral theorem. 


In order to obtain the interpretation of w(f)df as the average power dis¬ 
sipated in one ohm by those components of I(t) which lie in the band /, 
/ + df, we set r = 0 in (2.4-7): 


Limit L 

T — *oo T 





(2.4-8) 


I he expression on the left is certainly the total average power which would 
be dissipated in one ohm and the right hand side represents a summation 
over all frequencies extending from 0 to co. It is natural therefore to in¬ 
terpret w(f)df as the power due to the components in/,/+ df. 

The preceding sections have dealt with the power spectrum w(f) and corre¬ 
lation function i£(r) of a very general type of function. It will be noted 
that a knowledge of w(f) does not enable us to determine the original func¬ 
tion. In obtaining w(f), as may be seen from the definition (2.1-3) or from 
(2.3-6), the information carried by the phase angles of the various compo¬ 
nents of 1 (/) has been dropped out. In fact, as we may see from the Fourier 
series representation (2.3-1) of /(/) and from (2.3-6), it is possible to obtain 
an infinite number of different functions all of which have the same w(f), 
and hence the same $( T ). All we have to do is to assign different sets of 
values to the phase angles of the various components, thereby keeping 
a n + b n constant. 


2.5 Harmonic Analysis for Random Functions 

In many applications of the theory discussed in the foregoing sections 
/(/) is a function of t which has a certain amount of randomness associated 
with it. lor example /(/) may be a curve representing the price of wheat 
over a long period of years, a component of air velocity behind a grid placed 
in a wind tunnel, or, of primary interest here, a noise current. 

In some mathematical work this randomness is introduced by considering 
/(/) to involve a number of parameters, and then taking the parameters to 
be random variables. Thus, in the shot effect the arrival times h , h , • • • t K 
of the electrons were taken to be the parameters and each was assumed to be 
uniformly distributed over an interval (0, T). 

For any particular set of values of the parameters, /(/) has a definite power 
spectrum w(j) and correlation function i p(r). However, now the principal 
interest is not in these particular functions, but in functions which give the 
average values of w(f) and ifor fixed / and r. These functions are ob¬ 
tained by averaging w(f) and ^(r) over the ranges of the parameters, using, 
of course, the distribution functions of the parameters. 

By averaging both sides of the appropriate equations in sections 2.1 and 
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2.2 it is seen that our fundamental inversion formulae (2.1-5) and (2.1-6) 
are unchanged. Thus, 

w(J) = 4 [ \j/(r) cos 2t/t dr (2.5-1) 

Jo 

*(t) = [ w(J) COS 2t r/r df (2.5-2) 

Jo 

where the bars indicate averages taken over the parameters with / or rheld 
constant. 

The definitions of w and \f/ appearing in these equations are likewise ob¬ 
tained from (2.1-3) and (2.1-4) 

Hi) = Limit 2 AHd}]l (2.5-3) 

7—oo 1 

and 

T 

1(t) = Limit i [ I(t)I(t -f r) dt (2.5-4) 

7 — 00 1 *20 

The values of / and r are held fixed while averaging over the parameters. 
In (2.5-3) S(f) is regarded as a function of the parameters obtained from 

7(0 by 

S(J) = [ T I(t)e~ 2ri/t dt (2.1-2) 

*20 

Similar expressions may be obtained for the average power spectrum for 
d.c. and periodic components. All we need to do is to average the ex¬ 
pression (2.2-11) 

Sometimes the average value of the product I(t)I(t -f r) in the definition 
(2.5-4) of if'(r) is independent of the time T. This enables us to perform 
the integration at once and obtain 

Ur) = + r) (2.5-5) 

This introduces a considerable simplification and it appears that the simplest 
method of computing w(f) for an /(/) of this sort is first to compute £(t), and 
then use the inversion formula (2.5-1). 

2.6 First Example—The Shot Effect 

We first compute the average on the right of (2.5-5). By using the 
nethod of averaging employed many times in part I, we have 

00 

r«)/« + r) = £ p{K) + t) (2.6-1) 
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where p(K ) is the probability of exactly K electrons arriving in the inter¬ 
val (0, T), 



(1.1-3) 


K 

IkW = Z F(t - 4) (1.3-1) 

*—i 

Multiplying /*(/) and I K (t + r) together and averaging 4,4, 
over their ranges gives 

I K {t)lK{t + r) = EE t k )F(t + T - /„) 

*=1 m=l ^0 i JO 1 

This is similar to the expression for 7|(/) which was used in section 1.3 to 
prove Campbell’s theorem and may be treated in much the same way. 
Thus, if / and t + r lie between A and T — A, the expression above becomes 

f Ll + T)dt + k(k 7 7 1} [/ + 

When this is placed in (2.6-1) and the summation performed we obtain 
an expression independent of T. Consequently we may use (2.5-5) and get 

Z +oo 

F(t)F(t + T )dt+ lit) 2 (2.6-2) 

00 

where we have used the expression for the average current 

_ ,.+00 

1(1) = V F(t) dt (1.3- 4) 


In order to compute w(f) from \p(r) it is convenient to make use of the 
fact that \p(r) is always an even function of r and hence (2.5-1) may also 
be written as 



cos 2tt/t dr 


(2.6-3) 


Then 




f +°o 

J(jy cos 2t r/r dr 

00 
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+ * 


= 2v Real Part of 


dt F(t)e 


rift £ 


4-cc 


df F(t')e 


/\ 2 rift' 


+ 27 W- r «-'• 


Jr 


5 (/) | 2 + 2l(t) 6(f) 


(2.6-4) 


In going from the first equation to the second we have written /' = t -f r 
and have considered cos 2t/t to be the real part of the corresponding ex¬ 
ponential. In going from the second equation to the third we have set 


4-oc 


F(t)e 


—irif t 


(2.6-5) 


and have used 


r* e i2r,, dt = 6(f) 

J — cc 


(2.2-9) 


The term in w(f) involving 5(f) represents the average power which would 
be dissipated by the d.c. component of /(/) in flowing through one ohm. 
It is in agreement with the concept that the average power in the band 
0</<e, €>0 but very small, is 


f wij) dj = 2I(tf f 5(f) df 

J 0 Jo 


( 2 . 6 - 6 ) 


= m 


The expression (2.6-4) for w(f) may also be obtained from the definition 
(2.5-3) for w(f) plus the additional term due to the d.c. component ob¬ 
tained by averaging the expressions (2.2-11). We leave this as an exercise 
for the reader. He will find it interesting to study the steps in Carson’s 15 
paper leading up to equation (8). Carson’s R(a>) is related to our w(J) by 

w(f) = 2ixRfs*) 


and his f(ux>) is equal to our $(/). 

Integrating both sides of (2.6-4) with respect to/ from 0 to « and using 

P = f Mf) df 

Jo 

gives the result 

T* - I 2 = 2* jf “ | s(f) I 2 df (2.6-7) 

16 Loc. cit. 
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This may be obtained immediately from Campbell’s theorem by applying 
Parseval’s theorem. 

As an example of the use of these formulas we derive the power spectrum 
of the voltage across a resistance R when a current consisting of a great num¬ 
ber of very short pulses per second flows through R. Let F(t — tk) be the 
voltage produced by the pulse occurring at time . Then 

F{t) = R<p(t) 

where tp{t) is the current in the pulse. We confine our interest to relatively 
low frequencies such that we may make the approximation 

s(f) = [*“ R v (t)e- 2ri, ‘ dt 

j—00 

/ +00 

<p(t) dt = Rq 

00 

where q is the charge carried through the resistance by one pulse. From 
(2.6-4) it follows that for these low frequencies the continuous portion of 
the power spectrum for the voltage is constant and equal to 

w(f) = 2vR?q = 2 lR 2 q (2.6-8) 

where I = vq is the average current flowing through R. This result is often 
used in connection with the shot effect in diodes. 

In the study of the shot effect it was assumed that the probability of an 
event (electron arriving at the anode) happening in dt was vdt where v is the 
expected number of events per second. This probability is independent of 
the time t. Sometimes we wish to introduce dependency on time. 18 As an 
example, consider a long interval extending Jrom 0 to T. Let the prob¬ 
ability of an event happening in t, t + dt be Kp{t)dt where K is the average 
number of events during T and p{t) is a given function of t such that 

T 

[ p(t) dt = 1 

Jo 


For the shot effect p{t) = l/7\ 

What is the probability that exactly K events happen in 7? As in the 
case of the shot effect, section 1.1, we may divide (0, T) into N intervals 
each of length At so that NAt = T. The probability of no event happening 
in the first At is 



18 A careful discussion of this subject is given by Hurwitz and Kac in “Statistical 
Analysis of Certain Types of Random Functions.” I understand that this paper will 
soon appear in the Annals of Math. Statistics. 
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The product of N such probabilities is, as A r —* , At —♦ 0; 


exp 




This is the probability that exactly 0 events happen in T. 
we are led to the expression 



In the same way 


(2.6-9) 


for the probability that exactly A events happen in T. 

When we consider many intervals (0, T) we obtain many values of A and 
also many values of / measured / seconds from the beginning of each interval. 
These values of / define the distribution of / at time /. By proceeding as in 
section 1.4 we find that the probability density of / is 

P(I } t) = ~ f du exp \ —iul + K f P(x)(e' uFil ~ x) — 1 ) dx 

2 7T J — ao L 

The corresponding average and variance are 

T 

p(x)F{t — x ) dx 

(7 - f) 2 = K [ p(x)F\t - x) dx (2.6-10) 

JQ 




If S(f) is given by (2.1-2) and s(/) by (2.6-5) (assuming the duration of 
F(t) short in comparison with T) the average value of | S(f) | 2 may be ob¬ 
tained by putting (1.3-1) in (2.1-2) to get 

SkW = s(f) x: e- 2r,/ “ 

1 


Expressing S K (f) Sk( f), where the star denotes conjugate complex, as a 
double sum and averaging over the /*’s, using p(t), and then averaging over 
the K ’s gives 


I S(f) | 2 = K 




(2.6-11) 


This may be used to compute the power spectrum from (2.5-3) provided 
p(x) is not periodic. If p(x) is periodic then the method of section 2.2 
should be used at the harmonic frequencies. If the fluctuations of p(t) are 
slow in comparison with the fluctuations of F(t) the second term within the 
brackets of (2.6-11) may generally be neglected since there are no values of 
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/ which make both it and s(J) large at the same time. On the other hand 
if both pit) and F(t) fluctuate at about the same rate this term must be 
considered. 

2.7 Second Example— Random Telegraph Signal 16 

Let /(/) be equal to either a or —a so that it is of the form of a flat top 
wave. Let the intervals between changes of sign, i.e. the lengths of the 
tops and bottoms, be distributed exponentially. We are led to this dis¬ 
tribution by assuming that, if on the average there are n changes of sign per 
second, the probability of a change of sign in /, / + dt is ndt and is independ¬ 
ent of what happens outside the interval /, t + dt. From the same sort of 
reasoning as employed in section 1.1 for the shot effect we see that the 
probability of obtaining exactly K changes of sign in the interval (0, T) is 

PiK) = e-“ T (2.7-1) 

We consider the average value of the product /(/)/(/ + r). This product 
is a if the two /’s are of the same sign and is — a if they are of opposite sign. 
In the first case there are an even number, including zero, of changes of sign 
in the interval (/, t -f r), and in the second case there are an odd number of 
changes of sign. Thus 

Average value of /(/)/(/ + r) (2.7-2) 

= a X probability of an even number of 
changes of sign in /, t + r 

— a X probability of an odd number of 
changes of sign in /,/-{- r 

The length of the interval under consideration is | / + r — t\ = |r| seconds. 
Since, by assumption, the probability of a change of sign in an elementary 
interval of length A/ is independent of what happens outside that interval, 
it follows that the same is true of any interval irrespective of when it starts. 
Hence the probabilities in (2.7-2) are independent of t and may be obtained 
from (2.7-1) by setting T = | r | . Then (2.7-2) becomes, assuming r > 0 
for the moment, 

/(/)/(/ +T) = a [p{ 0) + p( 2) + pi 4) + * • *] 

— a 2 [pi 1) + pi3) + pi5) + • • •] 

2 —nr r i . (mt ) 2 i 

= ae L 1 "n + it " —J 

= a 2 e~ 2 “ T (2.7-3) 


16 Kenrick, cited in Section 2.2. 
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(2.7-4) 


17 


From (2.5-5), this gives the correlation function for lit) 


vKt) 


2 —2/i I r I 

= a e 


The corresponding power spectrum is, from (2.5-1), 


i 


ao 


-2fxr 


£-(/) = 4a‘ / e cos 2irfr dr 

*o 

2a 2 m 


(2.7-5) 


o /o | o 
7T‘_/“ -f \X~ 


Correlation functions and power spectra of this type occur quite fre¬ 
quently. In particular, they are of use in the study of turbulence in hydro¬ 
dynamics. We may also obtain them from our shot effect expressions if we 
disregard the d.c. component. All we have to do is tc assume that the 
effect Fit) of an electron arriving at the anode at time / = 0 is zero for 
t < 0, and that Fit) decays exponentially with time after jumping to its 
maximum value at / = 0. This mav be verified bv substituting the value 


Fit) = 2a|/^<T 2 ' 1 ', t> 0 (2.7-6) 

for Fit) in the expressions (2.6-2) and (2.6-4) (after using 2.6-5) for the 
correlation function and energy spectrum of the shot effect. 

The power spectrum of the current flowing through an inductance and a 
resistance in series in response to a very wide band thermal noise voltage is 
also of the form (2.7-5). 

Incidentally, this gives us an example of two quite different /(/)’s, one a 
flat top wave and the other a shot effect current, which have the same corre¬ 
lation functions and power spectra, aside from the d.c. component. 

There is another type of random telegraph signal which is interesting to 
analyze. The time scale is divided into intervals of equal length h. In an 
interval selected at random the value of I{t) is independent of the values in 
the other intervals, and is equally likely to be -\-a or —a. We could con¬ 
struct such a wave by flipping a penny. If heads turned up we would set 
lit) = a in 0 < / < //. If tails were obtained we would set /(/) = — a in 
this interval. Flipping again would give either -fa or —a for the second 
interval h < t < 2Ji, and so on. This gives us one wave. A great many 
waves may be constructed in this way and we denote averages over these 
waves, with t held constant, by bars. 

We ask for the average value of Iit)Iit + r), assuming r > 0. First 
we note that if r > h the currents correspond to different intervals for all 
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values of t. Since the values in these intervals are independent we have 

/(/)/(/ + r) = I(t) I(t + r) = 0 
for all values of t when r > h. 

To obtain the average when r < h we consider / to lie in the first interval 
0 < / < h. Since all the intervals are the same from a statistical point 
of view we lose no generality in doing this. If / + r < h, i.e., / < h - r, 
both currents lie in the first interval and 


I(t)I(t + r) = a 1 

If t > h — t the current /(/-+- t) corresponds to the second interval and 
hence the average value is zero. 

We now return to (2.5-4). The integral there extends from 0 to T. 
When r > //, the integrand is zero and hence 

i(r) = 0, t > h (2.7-7) 

When r < //, our investigation of the interval 0 < t < h enables us to write 
down the portion of the integral extending from 0 to h: 

t) dt = r ' a 2 dt+ r 0 dt 

•'0 Jo J h-r 

= a\h - r) 

Over the interval of integration (0, T ) we have T/h such intervals each 
contributing the same amount. Hence, from (2.5-4), 


^(r) = Limit (h 

t-+ oo 1 n 




0 < T < h 


(2.7-8) 


The power spectrum of this type of telegraph wave is thus 


w(f) = 4a 2 ^1 — cos 27r/r dr 

_ oz, (“ sin irfh\ 

\ irfk ) 


(2.7-9) 


This is seen to have the same general behavior as w(J) for the first type 
of telegraph signal given by (2.7-5), when we relate the average number, 
/x, of changes of sign per second to the interval length // by nh = 1. 
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2.8 Representation of Noise Current 

In section 1.7 the Fourier series representation of the shot effect current 
was discussed. This suggests the representation* 

X 

/(/) = S ( fl n cos O ) n t + b n sin c o n t) (2.8-1) 

n*l 

where 

U>n = 2 tT fn , fn = W-A/ (2.8-2) 

and are taken to be independent random variables which are distributed 
normally about zero with the standard deviation \ / w(f n ) A/. w(f) is the 
power spectrum of the noise current, i.e., w(f ) df is the average power which 
would be dissipated by those components of lit) which lie in the frequency 
range /, / + dj if they were to flow through a resistance of one ohm. 

The expression for the standard deviation of a n and b n is obtained when 
we notice that A/is the width of the frequency band associated with the ;;th 
component. Hence iu(f n )Af is the average power which would be dissi¬ 
pated if the current 


a n cos c o n t 4- b n sin c o n t 

were to flow through a resistance of one ohm. this average being taken over 
all possible values of a n and b n . Thus 

w(f n )Af = a n cos 2 a > n t -f 2 a n b n cos «„/ sin a o n t -f b\ sin 2 u n t* = a\ = b\ (2.8-3) 

The last two steps follow from the independence of a n and b n and the identity 
of their distributions. It will be observed that i4'(/), as used with the repre¬ 
sentation (2.8-1), is the same sort of average as was denoted in section 2.5 
by w{f). However, w(f) is often given to us in order to specify the spectrum 
of a given noise. 

For example, suppose we are interested in the output of a certain filter 
when a source of thermal noise is applied to the input. Let A(f) be the 
absolute value of the ratio of the output current to the input current when a 
steady sinusoidal voltage of frequency / is applied to the input. Then 

w(f) = cA\f) (2.8-4) 

* As mentioned in section 1.7 this sort of representation was used by Einstein and 
Hopf for radiation. Shottky (1918) used (2.8-1), apparently without explicitly taking 
the coefficients to be normally distributed. Nyquist (1932) derived the normal distribu¬ 
tion from the shot effect. 
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If XV is the average power dissipated in one ohm by /(/), 

T 

W = Limit ~ f f{t) dt 

T-+x T Jo 

= c f A\f ) df 

Jo 

which is an equation to determine c when If’ and A(f) are known. 

In using the representation (2.8-1) to investigate the statistical properties 
of lit) we first find the corresponding statistical properties of the summation 
on the right when the a' s and b } s are regarded as random variables distrib¬ 
uted as mentioned above and l is regarded as fixed. In general, the time 
/ disappears in this procedure just as it did in (2.8-3). \\ e then let i\ —-» » 

and A/ —> 0 so that the summations may be replaced by integrations. Fi¬ 
nally, the frequency range is extended to cover all frequencies from 0 to ac. 

The usual way of looking at the representation (2.8-1) is to suppose that 
we have an oscillogram of I{t) extending from / = 0 to / = . This oscil¬ 

logram may be cut up into strips of length T. A Fourier analysis of /(/) 
for each strip will give a set of coefficients. These coefficients will vary 
from strip to strip. Our representation (FA/ = 1) assumes that this varia¬ 
tion is governed by a normal distribution. Our process for finding sta¬ 
tistical properties by regarding the a' s and b’s as random variables while t 
is kept fixed corresponds to examining the noise current at a great many 
instants. Corresponding to each strip there is an instant, and this instant 
occurs at t (this is the / in (2.8-1)) seconds from the beginning of the strip. 
This is somewhat like examining the noise current at a great number of 
instants selected at random. 

Although (2.8-1) is the representation which is suggested by the shot 
effect and similar phenomena, it is not the only representation, nor is it 
always the most convenient. Another representation which leads to the 
same results when the limits are taken is 

iV 

I(t) = ^2 C n COS (o ) n t — <p n ) (2.8-6) 

n = 1 

where <p\ , <^ 2 , • • • <Pn are angles distributed at random over the range (0, 2 tt) 
and 

c n = [2u-(/n)A/] 1/2 , co n = 2 t rf n , fn = nAf (2.8-7) 

1 9 This representation has often been used by W. R. Bennett in unpublished memoranda 
written in the 1930’s. 
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In this representation /(/) is regarded as the sum of a number of sinusoidal 
components with fixed amplitudes but random phase angles. 

That the two different representations (2.8-1) and (2.8-6) of I{t) lead 
to the same statistical properties is a consequence of the fact that they are 
alwavs used in such a wav that the “central limit theorem*” may be used 
in both cases. 

This theorem states that under certain general conditions, the distribu¬ 
tion of the sum of .V random vectors approaches a normal law (it may be 
normal in several dimensions**) as N —» -c . In fact from this theorem it 
appears that a representation such as 

A' 

/(/) = X (<*n COS C On l + b n sin Hint) (2.8-8) 

n*= 1 

where a n and b n are independent random variables which take only the values 
dt [u'(f n ) A/] 1 ”, the probability of each value being J, will lead in the limit 
to the same statistical properties of /(/) as do (2.8-1) and (2.8-6). 


2.9 Thf. Normal Distribution in Several Variables 20 

Consider a random vector r in A dimensions. The distribution of this 
vector may be specified by stating the distribution of the K components, 
•Vi , a *2 , • • ■ x K , of r. r is said to be normally distributed when the prob¬ 
ability density function of the x’s is of the form 

(2tt)"* /2 | M T 1/2 exp [ — \x'M~ l x] (2.9-1) 


where the exponent is a quadratic form in the *’s. The square matrix M 
is composed of the second moments of the .v’s. 


Mil M12 • * • Mi/r 

\I — • • 

_Ml K * * * Hkk_ 

where the second moments are defined by 

Mil = *i , M 12 = * 1 X 2 > etc. 

i M I represents the determinant of M and x' is the row matrix 


(2.9—2) 


(2.9-3) 


= lXl,X2, ••• X K ) 


(2.9-4) 


x is the column matrix obtained by transposing x'. 


* See section 2.10. 

** See section 2.9. 

20 H. Cramer, ’‘Random Variables and Probability 
Tract No. 36 (1937). 


Distributions,” Chap. X., Cambridge 
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The exponent in the expression (2.9—1) for the probability density may 
be written out by using 

x'M-'x = tt^, x,x. (2.9-5) 

r« 1 a-1 | M I 

where M rs is the cofactor of fi rs in \M\. 

Sometipies there are linear relations between the x’s so that the random 

vector r is restricted to a space of less than K dimensions. In this case the 

appropriate form for the density function may be obtained by considering 

a sequence of A'-dimensional distributions which approach the one being 
investigated. 

If r\ and r 2 are two normally distributed random vectors their sum r x -f r 2 
is also normally distributed. It follows that the sum of any number of 
normally distributed random vectors is normally distributed. 

The characteristic function of the normal distribution is 


ave £ , * lXl+, * 2T2 '*- 'r'tRZK 



(2.9-6) 


2.10 Central Limit Theorem 


The central limit theorem in probability states that the distribution of the 
sum of .V independent random vectors r y + r 2 + • • • + r N approaches a 
normal law as A > oc when the distributions of r y , r 2 , • • • ts satisfy certain 
general conditions. 7 

As an example we take the case in which r y , r 2 , • • • are two-dimensional 
vectors , the components of r n being .r n and y„ . Without loss of generality 
we assume that 

x n = 0, y n = 0. 

The components of the resultant vector are 


X = X\ + Xi + • • • -f- xs 

Y = yi + y 2 + • • • + y N 


( 2 . 10 - 1 ) 


and, since r y , r 2 , • • • are independent vectors, the second moments of the 
resultant are 


v 2 2 , 2 , ,2 

fin = X = Xi + X2 + * • • + X N 

/i 22 = 1 2 = yi + >’2 + • • * -T yl (2.10-2) 

M12 = X I = Xiyi + Xvy 2 -T * * • ■+■ x N y N 

7 Incidentally, von Laue (see references in section 1.7) used this theorem in discussing 

the normal distribution of the coefficients in a Fourier series used to represent black-body 
radiation. He ascribed it to Markoff. 

21 This case is discussed bv J. V. Uspensky, “Introduction to Mathematical Probabil¬ 
ity”, McGraw-Hill (1937) Chap. XV. 


50 








183 


Apparently there are several types of conditions which are sufficient to 

ensure that the distribution oi tne resultant approaches a normal law. One 

• ... 21 
sufficient condition is that* 




(2.10-3) 


The central limit theorem tells us that the distribution of the random 
vector (X, Y ) approaches a normal law as X —► qc . The second moments 
of this distribution are given by (2.10-2). When we know the second mo¬ 
ments of a normal distribution we may write down the probability density 
function at once. Thus from section 2.9 



M I = 


— MllM22 — Ml2 



*' = [X, Y] 


x'M 'x = \M\~\nnX 1 - 2 nnXY + unY 2 ) 


The probability density is therefore 

(M 11 M 22 — M 12 ) 1/2 


2ir 



— M 22 X — aui Y 4~ 2^12 XY 
2 (mhM 22 — M 12 ) 


(2.10-3) 


Incidentally, the second moments are related -to the standard deviations 
<7i , 02 of X, V and to the correlation coefficient r of X and Y by 

2 2 

Mu — Ol , M 22 = <T 2 y M 12 = T(JiC72 (2.10~4) 

and the probability density takes the standard form 



27TO'l (J 2 




XY 

2 T -j- 

0 1 <T2 



(2.10-5) 


21 This is used by Uspensky, loc. cit. Another condition analogous to the Lindebere 
condition is given by Cramer, 20 loc. cit. 
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PART III 


STATISTICAL PROPERTIES OF RANDOM NOISE CURRENTS 

3.0 Introduction 

In this section we use the representations of the noise currents given in 
section 2.8 to derive some statistical properties of /(/). The first six sec¬ 
tions are concerned with the probability distribution of l{t) and of its zeros 
and maxima. Sections 3.7 and 3.8 are concerned with the statistical prop¬ 
erties of the envelope of /(/). Fluctuations of integrals involving I 2 (t) 
are discussed in section 3.9. The probability distribution of a sine wave 
plus a noise current is given in 3.10 and in 3.11 an alternative method of 
deriving the results of Part III is mentioned. Prof. Uhlenbeck has pointed 
out that much of the material in this Part is closely connected with the 
theory of Markoff processes. Also S. Chandrasekhar has written a review 
of a class of physical problems which is related, in a general way, to the 
present subject. 

3.1 The Distribution of the Noise Current 2 * 

In section 1.4 it has been shown that the distribution of a shot effect 
current approaches a normal law as the expected number of events per 
second, v , increases without limit. 

In line with the spirit of this Part, Part III, we shall use the representation 

N 

1(0 = 12 ( fl n COS O ) n t + b n sin co n /) (2.8-1) 

n—1 

to show that /(/) is distributed according to a normal law. This is obtained 
at once when the procedure outlined in section 2.8 is followed. Since a n 
and b n are distributed normally, so are a n cos a>„/ and b n sin c o n t when t is 
regarded as fixed. /(/) is thus the sum of 2N independent normal variates 
and consequently is itself distributed normally. 

22 Stochastic Problems in Physics and Astronomy, Rev. of Mod. Phys., Vol. 15, pp. 

1-89 (1943). . T . . 

M An interesting discussion of this subject by V. D. Landon and K. A. Norton is given 

in the I.R.E. Proc., 30 (Sept. 1942) pp. 425-429. 
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The average value of 1(1) as given by (2.8-1) is zero since d n = b n = 0: 

7(0 = 0 (3.1-1) 

The mean square value of /(/) is 

.V _ _ 

P(t) = 23 ( a n COS 2 + b 2 n sin 2 C 0 n t) 

n* 1 

.V 

= E w(fn)&f (3.1-2) 

n« 1 

w(f) df = *(0) = \pa 

In writing down (3.1-2) we have made use of the fact that all the a 1 s and b’s 
are independent and consequently the average of any cross product is zero. 
We have also made use of 

a n ~ b n == w(f n )Af y f n = fjA /, <jJ n = 27r/ n 

which were given in 2.8. i£(r) is the correlation function of lit) and is 

related to Mf) by 

xPr = \P(t) = [ w(f) cos 2t rfr df (2.1-6) 

jo 

as is explained in section 2.1. In this part we shall write the argument of 
' P(t) as a subscript in order to save space. 

Since we know that lit) is normal and since we also know that its average 

is zero and its mean square value is \pQ , we may write down its probability 

density function at once. Thus, the probability of /(/) being in the 
range /, / -f dl is 



dl 

y/ 27n/' 0 


e -* 2 l 2*0 


(3.1-3) 


This is the probability of finding the current between I and I + dl at a 
time selected at random. Another way of saying the same thing is to state 
that (3.1-3) is the fraction of time the current spends in the range /, / -f <// 
In many cases it is more convenient to use the representation (2.8-6) 

/V 

= S Cn C ° S ~ (pn ') } c * n ~ 2 w(f n )Af (2.8-6) 


in which <p\ , • • • <p n are independent random phase angles. In order to 
deduce the normal distribution from this representation we first observe 
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that (2.8-6) expresses /(/) as the sum of a large number of independent ran¬ 
dom variables 

I(t) = X\ + X 2 + • • • + Xn 
X n = C n COS (ojJ ” <Pn) 

and hence that as N —> °c /(/) becomes distributed according to a normal 
law. In order to make the limiting process definite we first choose N and 
Af such that NAf = F where 

w(f) df < e [ w(f) df 

Jo 

where € is some arbitrarily chosen small positive quantity. We now let 
AT —> oo and A/ —* 0 in such a way that NAf remains equal to F. Then 

A = X\ + x\ + • * • + *n — 


B = I xi I 3 + • • • + \xn\* = 

< 

where the bars denote averages with respect to the <p’ s, t being held constant. 
If we assume that the integrals are proper, the ratio BA~ m 0 as N —> 00 , 
and consequently the central limit theorem* may be used if w(f) = 0 for 
f > F. Since we may make F as large as we please by choosing e small 
enough, we may cover as large a frequency range ,as we wish. For this 
reason we write <» in place of F. 

Now that the central limit theorem has told us that the distribution of 
/(/), as given by (2.8-6), approaches a normal law, there remains only the 
problem of finding the average and the standard deviation: 

N 

/(/) = 23 COS (c O n t — <Pn) = ® 

P(t) = C 2 n COS 2 (w,/ ” <Pn) (3.1“5) 

—» [ w{f) df = to 
Jo 




* Section 2.10. 
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This gives the probability density (3.1-3). Hence the two representations 
lead to the same result in this case. Evidently, they will continue to lead 
to identical results as long as the central limit theorem may be used. In the 
future use of the representation (2.8-6) we shall merely assume that the 
central limit theorem may be applied to show that a normal distribution 
is approached. We shall omit the work corresponding to equations (3.1-4). 

The characteristic function for the distribution of lit) is 


*uiu) A <Ao 2 

ave. e = exp — — u 


(3.1-6) 


3.2 The Distribution of 7 (/) and I (t T r) 

We require the two dimensional distribution in which the first variable 
is the noise current /(/) and the second variable is its value /(/ t) at some 
later time r. It turns out that this distribution is normal' 4 , as we might 
expect from the analogy with section 3.1. The second moments of this 
distribution are 


Mil = P(l) = to = 



M22 — to 

Mi 2 = T- r) 


(3.2-1) 


== yf, r 

I he expression for M 12 is in line with our definition (2.1-4) for the correla¬ 
tion function: 


T 

tr = t(r) = Limit ^ f /(/)/(/ -f r) 

r—oo 1 J o 


dt 


(2.1-4) 


In order to get the distribution from the representation (2.8-6) 


we write 


S 


h = /(/) = X) c n cos (w„/ — tp n ) 


S 


■^2 I(t -f t) C n COS (dj„ t — ff n -f- (j) n j'j 

H. rr" S U (\ 0 9 3°6) , a 8«5. diStnbUti0n in "Oise was 
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From the central limit theorem for two dimensions it follows that I\ and 7 2 
are distributed normally. As in (3.1) 


Mil 


= 1 1 = jC | [ w(f) df = to 

1 Jo 


M 22 — l\ — l\ — to 


(3.2-2) 


N 


M 12 


= /i/ 2 = 5Z c n ave. jcos (o3 n t — <^n) cos (w„/ — ^ + w„r)| 


Now the quantity within the parenthesis is 

cos 2 (<j) n t — <fn) cos w n T — cos (a>„/ — <^ n ) sin (w„/ — <p n ) sin cj„t 

and when we take the average with respect to <p n the second term drops 
out, giving 

M12 = il c\ • \ cos U„ T —» [ w{f) cos 2?r/r if/ = (3.2-3) 

1 ^0 

where we have used Wn = 2 tt/„ and the relation (2.1-6) between w(/) and ^(r). 

The probability density function for T\ and 1 2 may be stated. From the 
discussion of the normal law in 2.9 it is 

\tl — ^r] _1/2 . f—^ q/I — lo/2 + 2» r /l/ S 1 

7 r eXP L 7Ul — xl/l) J 


27 t 1 L 2(^0 — ^ i ) 

For a band pass filter whose range extends from f a to f- 0 we have 

r/b 

\p T = J u'o cos 2-jrfr df 


(3.2-4) 


= Wo 


Sin 03b T — Sin 03 a T 
2ttt 


(3.2-5) 


= —- sin 7 TT(Jb ” fa) COS 7Tt(/& + fa) 

7TT 

to = Wo(fb “ fa) 

where w 0 is the constant value of w(f) in the pass band and 

03b — 2irfb (3.2-6) 

0) a = ^7 vfa 

According to our formula (3.2-4), h and I, are independent when 
is zero. For the r’s which make zero, a knowledge of /, does not add to 
our knowledge of h . For example, suppose we have a narrow filter. Then 

\J/ T = 0 when r = [2(/& -f* /a)] 

\f/ r is nearly — to when r = [fb 4- fa] 
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For the first value of r, all we know is that / 2 is distributed about zero with 
I\ — \po . For the second value of r / 2 is likely to be near — 1\ . This is 
in line with the idea that the noise current through a narrow filter behaves 
like a sine wave of frequency \ (fb T fa) (and, incidentally, whose amplitude 
fluctuates with an irregular frequency of the order of — f a )). The first 
value of r corresponds to a quarter-period of such a wave and the second 
value to a half-period. By drawing a sine wave and looking at points sepa¬ 
rated by quarter and half periods, the reader will see how the ideas agree. 

The characteristic function for the distribution of I\ and / 2 is 


_ iul 1 +»' vl 2 n Y 0 / 2 , 

ave. e = exp — — (*< + v 


£ —y + v) — \P,uv^ 


(3.2-7) 


The three dimensional distribution in which 

h = /(0 

h — I(t + t\) 

I3 = I(t + T\ + T 2 ) 

where t\ and r 2 are given and t is chosen at random is, as we might expect, 
normal in three dimensions. The moments, from which the distribution 
may be obtained by the method of Section 2.9, are 

M11 = M22 = M33 — fo 
M12 = \p Tl 
M23 = 'l'r 2 

M13 = \Kti -f T 2 ) = \p T j + r 2 

The characteristic function for I\ , Ii , 13 is 
ave £ <Xl/ i' H2 2/2+**j/3 


ex P[ y ( z i + z 2 + 23) — M12Z1Z2 — M23Z2Z3 — M132123J ^ 

3.3 Expected Number of Zeros per Second 
We shall use the following result. Let y be given by 

y = F ( a ' > > * * * a s ; x), (3.3-1) 

and let the a’s be random variables. For a given set of a' s, this equation 
gives a curve of y versus x. Since the a ’s are random variables we shall call 
this curve a random curve. Let us select a short interval x x , Xl + dx, 
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and then draw a batch of a’s. The probability that the curve obtained by 
putting these a’s in (3.3-1) will have a zero in x\ , xi + dx is 


+00 


dx 


v I P(0, v; xi) d-n 


(3.3-2) 


and the expected number of zeros in the interval (xi, xi) is 


+ 00 


dx 


V I P( 0, v; x) drj 


(3.3-3) 


In these expressions />(£, rj ; x) is the probability density function for the 
variables 


£ = F(a x , • • • x) 
dF 

V = t - 
dx 


(3.3-4) 


Since the a’s are random variables so are £ and 77 , and their distribution 
will contain .r as a parameter. This is indicated by the notation />(£, 77 ; x). 

These results may be proved in much the same manner as are similar 
results for the distribution of the maxima of a random curve. This method 
of proof suffers from the restriction that the a’s are required to be bounded . 25 
Results equivalent to (3.3-2) and (3.3-3) have been obtained independently 
by M. Kac . 26 His method of proof has the advantage of not requiring the 
a’s to be bounded. 

Here we shall sketch the derivation of a closely related result: The prob¬ 
ability that y will pass through zero in xi , xi + dx with positive slope is 


dx / 7)p(0y 77 ; x Y ) drj 

Jn 


(3.3-5) 


We choose dx so small that the portions of all but a negligible fraction 
of the possible random curves lying in the strip (*i , x\ + dx) may be re¬ 
garded as straight lines. If y = £ at X\ and passes through zero for X\ < x < 

xi + dx, its intercept on y = 0 is x\ — - where 77 is the slope. Thus £ and 77 

V 

must be of opposite sign and 

xi < xi — - < X\ + dx 

V 

25 S. O. Rice, Atner. Jour. Math. Vol. 61, pp. 409-416 (1939). However, L. A. MacColl 
has pointed out to me that a set of sufficient conditions for (3.3-5) to hold is: (a) />(£, 17 ; x) 
is continuous with respect to (£, rj) throughout the ^ 7 -plane; and (b) that the integral 


/ P( a V> v; 
Jo 


Xi)drj 


converges uniformly with respect to a in some interval —a 1 < a < , where a\ and a 2 

are positive. These conditions are satisfied in all the applications we shall make use of 

(3.3-5). 

26 M. Kac, Bull. Atner. Math. Soc. Vol. 49, pp. 314—320 (1943). 
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According to the statement of our problem, we are interested only in positive 
values of 77, and we therefore write our inequality as 

- n dx < £ < 0 

For a given random curve i.e. for a given set of a' s £ and 77 have the values 
given by 


£ = F(a 1 , • • • a s ; *i) 



If these values of £ and 77 satisfy our inequality, the curve goes through zero 
in *1 , xi -f- dx. The probability of this happening is 27 


[ dr > / , r , *0 = [ [0 - (-,</*)]/>((), 77; x.) rf, 

U —tj az J() 


where we have made use of the fact that dx is so very small that £ is effec¬ 
tively zero. The last expression is the same as (3.3-5). 

In the same way it may be shown that the probability of y passing through 
zero in *1 , *1 dx with a negative slope is 

— dx / Vp( 0, 77 ; xi) dr] (3.3-6) 


Expression (3.3-2) is obtained by adding (3.3-5) and (3.3-6). 

We are now ready to apply our formulas. We let /, /(/) and play the 
roles of *, y, and a n , respectively, and use 




C n COS (o>n / — <£?n) > 


cl = 2 w(f)Af ( 2 . 8 - 6 ) 


, MmCoU has remarked that the step from the double integral on the left hand side 
of this equation to the final result (3.3-5) may be made as follows: C 

It is easily seen that the probability density we are seeking is 


d(Ax) 


M 




P(Z, x) 


Az—0 


(for^cTctli&e ^ ** ° perati °" s 


_d_ r® r° r 

dAx L d7) I Vi X) ^ = / Vp(-vAx f V ; x) dr, 

and hence the required probability density is 



V', x) drj 
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The first step is to find the probability density function of the two random 
variables 


4 » 

£ COS (c O n — <Pn) 


n—1 


4 V 

V I (^l) ^ v Cn tOn sin (cOn ^1 <^n) 


(3.3-7) 


n=>l 


where the prime denotes differentiation with respect t. From section 2.10 

Mu — £ 2 = *o 


M22 


a . _—_ 

= V 2 — Cn W 2 n sin 2 (o> n /i — ipn) 


n«l 


= S (27r/„) 2 w(/„)A/ 


n—1 


4^ r fw<j) df = 

Jo 


M12 


4 * __ 

= fi7 = "Z f nW„ COS (a>„ /i — <?„) sin (a> n t\ — v? n ) 


n= 1 


The expression for ju 2 j arises from (2.1-6) by differentiation. In this expres¬ 
sion * 0 denotes the second derivative of *{t) with respect to r at r = 0: 


*"(j) = —47r 2 f f w(J) cos 27 t/t df 

Jo 


(3.3-8) 


Hence the probability density is 

i-Mo'r 112 

Pit, v; t) = 1 *° 2 ;° J exp 


[- 


i + i 

2*o 2*o 


(3.3-9) 


where *o is negative. It will be observed that the expression on the right 
is independent of t. Hence the probability of having a zero in h , h -f- dt 9 

*Cs”*-Q-^Y <-»> 

which follows from (3.3-3), is independent of t. 

The expected number of zeros per second, which may be obtained from 
(3.3-3) by integrating (3.3-10) over an interval of one second, is 


[— *o*o] 1/2 
2tt ^ 


drj 


(3.3-10) 




*"( 0 ) 

HO) 


Jl/2 


J fv>(J)df 

Jo _ 

J w(J) df 


1/2 


(3.3-11) 
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For an ideal band pass filter whose pass band extends from f a to fb the 
expected number of zeros per second is 



(3.3-12) 


When f a is zero this becomes 1.155 fb and when f a is very nearly equal to 
1b it approaches fb -f fa . 

«> ^ 

In a recent paper M. Kac‘ has given a result which, after a slight gene¬ 
ralization, leads to 



(3.3-13) 


for the probability that the noise current will pass through the value / 
with positive slope during the interval /, / + dt. The expected number of 
such passages per second is 

e 1 X I j the expected number of zeros per second] (3.3-14) 

The expression (3.3-13) may also be derived from analogue of (3.3-5) 
obtained by replacing the zero in p(0, 77 ; xi) by y. 

In some cases the integral 


i/'o = — 47 t 2 / fw(J) df 

Jo 

does not converge. 

An example occurs when we apply a broad band noise voltage to a re¬ 
sistance and condenser in series. The.power spectrum of the voltage across 
the condenser is of the form 


w(J) 


1 

P + a 2 


(3.3-15) 


Although xfo is infinite, \f 0 is finite and equal to -rr/2a. A straightforward 

substitution in our formula (3.3-11) gives infinity as the expected number 
of zeros per second. 

Some light is thrown on this breakdown of our formula when we consider 
a noise current consisting of two bands of noise. One band is confined to 
relatively low frequencies, and its power spectrum will be denoted by 
wi(/). The other band is very narrow and is centered at the relatively high 
frequency f 2 . The complete power spectrum of our noise is then 


w(f) = Wl (f) -f A 2 8(f - / 2 ) 


28 On the Distribution of Values of Trigonometric Sums with Linearly Indeoendent 
Frequencies, Amer. Jour. Math., Vol. LXV, pp 609-615, (1943). J inae P endent 



where the unit impulse function <5 is used to represent the very narrow band. 
The power spectrum of the narrow band is approximately the same as that 
of the wave A \/2 cos 2nrf 2 t. 

The integrals occurring in our formula are 

[ w(J) df=[ «*(/) df + A 2 

Jo Jo 

= W + A 2 

l w(J)f df = l fiuiij) df + Afl 

= U + A 2 fl 

We suppose that A and /> are such that 

W » A 2 


U « A 2 f \. 

Then our formula (3.3-11) gives us the expected number of zeros 

2 Af L 

W 112 


We may give a qualitative explanation of this formula if we regard our 
noise current as composed of a small component 

1 2 = 2 ll2 A cos 271 / 2 / 


due to the narrow band superposed on a large, slowly varying component 
due to the lower band. Since the r.m.s. value of the second component is 
W 112 we may assign it a representative frequency fi and write it approxi¬ 
mately as 

h = (2W) 1/2 cos 2n ftt 

The zeros of the noise current are clustered around the zeros of the second 
wave. Near such a zero 

/, = ±(2W) in 2-n-fiAl 


where At is the distance from the zero. The oscillations of h produce zeros 
when | h | is less than the amplitude of / 2 or when 

A > IT 1/2 2tt/i I At | 


and the interval over which zeros are produced is given by 

AW~ 1/2 


2A t = 


7./1 
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The number of zeros is this multiplied by 2 / 2 . Since there are 2/i such 
intervals per second the number of zeros per second is 

4 

7T 


AlV~ 1,2 f2 


This differs from the result given by our formula by a factor of 2 7 r. 
This discrepancy is due to our representing the two bands by the sine waves 
1 1 and / 2 . 

From this example we obtain the picture that when the integral for i /- 0 
converges corresponding to A —> 0 , while at the same time the integral for 
\p 0 diverges, corresponding to f> —► x in such a way that .-l / 2 —► =© , the 
noise current behaves something like a continuous function which has no 
derivative. It seems that for physical systems the integrals will always 
converge since parasitic effects will have the effect of making ie(/) tend to 
zero rapidly enough. The frequency which represents the region where 
this occurs is of the order of the frequency of the microscopic wiggles. 


So far we have been considering the formulas of this section in the most 
favorable light possible. I here arc experiments which indicate the possi¬ 
bility of the formulas breaking down in some cases. Prof. Uhlenbeck has 
pointed out that if a very broad band fluctuation current be forced 20 to flow 
through a circuit consisting of a condenser, C, in parallel with a series com¬ 
bination of inductance, L, and resistance, R , equation ( 3 . 3 - 11 ) says that the 
expected number of zeros per second of the current, /, flowing through R 

(and L) is independent of R. It is simply ~(Z,C)~ 1/2 . The differential 

7r 

equation for / is the same as that which governs the Brownian motion of a 
mirror suspended in a gas 30 , the gas pressure playing the role of R. Curves 
are available for this motion and it is seen that their character depends 
greatly upon the pressure 31 . Unfortunately, it is difficult to tell from the 
curves whether the expected number of zeros is independent of the pressure. 
The differences between the curves for various pressures indicates that there 
may be some dependence*. 


3.4 The Distribution of Zeros 

The problem of determining the distribution function for the distance 
between two successive zeros seems to be quite difficult and apparently 

ao example, by putting the circuit in series with a diode. 

/>34 "(l^n^l 5 m i 0ti ° n iS discussed G ' E - Uhlenbeck and S. Goudsmit, 

“ E. Kappler, Annalen d. Phys., 11 (1931) 233-256. 

^ W ? S wntten . M - K * c and H. Hurwitz ljave studied the problem of the ex- 
pected number of zeros using quite a different method of approach which employs the 

s , ot ‘^? ec . t representation (Sec. 3.11). Their results confirm the correctness of (3 3-11) 

* e mtegral 5 c ? n verge. When the integrals diverge the average nuXr of elec¬ 
trons, per sec. producing the shot effect must be considered. 
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nobody has as yet given a satisfactory solution. Here we shall give some 

results which are related to the general problem and which give an idea of 

the form of the distribution for the region of small spacings between the 
zeros. 

We shall show (in the work starting with equation (3.4-12)) that the 
probability of the noise current, /, passing through zero in the interval 
r, T + dr with a negative slope, when it is known that I passes through zero 
at t = 0 with a positive slope, is 



U'o - ^r 3/2 [l + HcoC\-H)} 


(3.4-1) 


where 3/ 22 and Af 23 are the cofactors of w = — \po and /i 23 = — in the 
matrix 



H = - M 2S ]" 1/2 . 


(3.4-2) 


We choose 0 < cot 1 (-H) < 7r, the value 7r being taken at r = 0, and the 
value tt/ 2 being approached as r —> oo. It should be remembered that we 
are writing the arguments of the correlation functions as subscripts, e.g., 
— ipr is really 



(3.3-8) 


As r becomes larger and larger the behavior of / at r is influenced less 
and less by the fact that it goes through zero with a positive slope at r = 0. 
Hence (3.4-1) should approach the probability that, for any interval of 
length dr chosen at random, I will go through zero with a negative slope. 
Because of symmetry, this is half the probability that it will go through 
zero. Thus (3.4-1) should approach, from (3.3-10), 


dr r -£T 2 

2tt _ \J/o 


(3.4-3) 


as r —* cc. It actually does this since M approaches a diagonal matrix 
and both M& and U approach zero with M<a/H —► M& —> —^o^o- For a 
low pass filter cutting off at/& (3.4-3) is 

drfbS~ 1/2 (3.4-4) 


The behavior of (3.4-1) as r —► 0 is quite a bit more difficult to work out. 

64 


A/o 2 and A /23 go to zero as r 4 , A /22 — AfJs as r 10 , and consequently H goes 
to infinity as r -1 . The final result is that (3.4-1) approaches 


8 L —ypoypQ J 


(3.4-5) 


as r —* 0, assuming \p (i exists. Here the superscript (4) indicates the fourth 
derivative at r = 0, 



(3.4-6) 


For a low pass filter cutting off at fb (3.4-5) is 



(3.4-7) 


When (3.4-1) is applied to a low pass filter, it turns out that instead of r 
the variable 


s? = 27r/6T, d<f = 2wfb dr (3.4-8) 

is more convenient to handle. Thus, if we write (3.4-1) as p(<p) d^, it fol¬ 
lows from (3.4-4) and (3.4-7) that 

P(<p) — > 2tt\/3 = as ^ 

(3.4-9) 

P(<?) TR as 


P(*fi) has been computed and plotted on Fig. 1 as a function of p for the 
range 0 to 9. From the curve and the theory it is evident that beyond 
9 p(ip) oscillates about 0.0919 with ever decreasing amplitude. 

We may take p(v) d<p to be the probability that I goes through zero in 
<P, <P dp y when it is known that I goes through zero at <p = 0 with a slope 
opposite to that at <p. p(<p) d<p exceeds the probability that I goes through 

zero at ip = 0 and in tp + d<p with no zeros in between. This is because 
p(v) d<p includes all curves of the latter class and in addition those which 
may have an even number of zeros between 0 and <p. From this it follows 

that the curve giving the probability density of the intervals between zeros 
must be underneath the curve of p(<p). 

A partial check on the curve for p(<p) may be obtained by comparing it 
with a probability density function obtained experimentally by M. E. 
Campbell for the intervals between 754 successive zeros. He passed thermal 
noise through a band pass filter, the lower cutoff being around 200 cps and 
the upper cutoff being around 3000 cps. The upper cutoff was rather grad- 
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ual and it is difficult to assign a representative value. The crosses on figure 
1 are obtained from his data when we assume that his filter behaves like a 
low pass filter with a cutoff at fb = 2850, this choice being made in order 
to make the maximum of his curve coincide with that of p(<p). 

It is seen that some of the crosses lie above p(<p). This is probably due 
to the fact that the actual filter differs somewhat from the assumed low pass 
filter. 

On I ig. 1 there is also plotted a function closely related to (3.4-1). It 
is the low pass filter form of the following: The probability of I passing 



Fig. 1—Distribution of intervals between zeros—low-pass filter 
is probability of a zero in A<p when a zero is at origin. 

is probability of a zero in Ay? when a zero is at origin and slopes at zeros are of 
opposite signs. 

yn = P(<p)>fb ~ filter cutoff, r = time between zeros. 

through zero in r, r + dr when it is known that I passes through zero at 
r = 0 is 


~ [4^'] [^f] 3,2 [1 + H tan -1 H) (3.4-10) 

where the notation is the same as in (3.4-1) and — ^ < tan -1 H < 

This curve should always lie above p{<p) and the small difference between 
the curves out to <p = 4 indicates that the true distribution of zeros is given 
closely by p(<p) out to this point. 

When (3.4-1) is applied to a relatively narrow band pass filter or some 
similar device we may make some approximations and obtain an expression 
somewhat simpler than (3.4-1). As a guide we consider our usual ideal 
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band pass filter whose range extends from f a to f b . The correlation function 
is given by (3.2-5). 


tr = - sin 7 Tt( f b — fa) COS 7 rr (/ 6 + fa) 

7rr (3.2-5) 

fo — Wo{fb — fa) 

From physical considerations we know that in a narrow filter most of the 
distances between zeros will be nearly equal to 

T1 = 

i.e., nearly equal to the distance between the zeros of a sine wave having 
the mid-band frequency. We therefore expect (3.4-1) to have a peak very 
close to ri . We also expect peaks at 3ri , 5ri etc. but we shall not consider 
these. We wish to examine the behavior of (3.4-1) near ti . 

It turns out that M 23 is nearly equal to AT * 2 so that H is large and (3.4-1) 
becomes approximately 

dr T W° T 2 3 /23 _ 

2 L-^o'J 

where r is near ri . 

In order to see that M 23 is nearly equal to Af 2 2 we use the expressions 

.V /22 = —to (to ~ tl) — tot? 

M 23 = tr (tl — I pi) + 

3^22 4- 3/23 = (\p 0 — tr)[(to + tr)(tr — to) — tr 2 ] 

= (to ~ tr)[B + C] 

34 22 — 4/23 = (to + tr)[(to — tr)(— t r — to) — 

= Wo + tr)[~ B + C] 

B = tot r “ trto 

C = ~toto + trtr — tr 2 

From (3.2-5) it is seen that tr may be written as 

tr = A cos (3t, /3 = 7r(/ 6 + / a ) 

where /3ri = tt and A is a function of r which varies slowly in comparison 
with cos /3r. We see that near n , is nearly equal to —to • Likewise 
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\p T hovers around zero and \f/ T is nearly equal to — \po . Differentiating with 
respect to r gives 

= A' cos (3t — Af3 sin /3r 
= (A" - A/3 2 ) cos (3t - 2A'(3 sin 0r 
= Ao — Aq/3 2 , \f/ 0 = Ao 

where Ao and A 0 are the values of A and its second derivative at r equal 
to zero. These lead to 

B = (AqA" — A A o) cos (3t — 2AoA'(3 sin 0t 

C = (AA" - A' 2 ) cos 2 (3t - A 0 Ao + (A 2 0 - A) 2 (3 2 

We wish to show that C + B and C — B are of the same order of magni¬ 
tude. If we can do this, it follows that Mi 2 — M 23 is much smaller than 
Mi 2 + Mi Z since \po — ^p Tl is approximately 2^ 0 while \p 0 + x// r i is quite small. 
Consequently we will have shown that M 23 is nearly equal to Mu . 

So far we have made no approximations. We now express the slowly 
varying function A as a power series in r. Since xf/'o and xp'o" must be zero 
for the type of functions we consider, it follows that 

A = Ao + y Ao' + • • 

A ' = tAo + • • 

A" = A' 0 ' + | A? + • • 

where we neglect all powers higher than the second. Multiplication and 
squaring gives 

A 2 - Ao = tAoAo 

AA" - A’ 2 = AoAo + j (AoAP - A” 2 ) 

= AqA o 4" F 

AoA" - AA" = ^ (AoAl* - Ao 2 ) = F 

Since, for small r, A and A" are nearly equal to A 0 and Ao, respectively 
we see that the difference on the left is small relative to A 0 Ao, i.e., 

\F\ << \A 0 Ao | 
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Our expression for B and C become approximately 

B = F cos /3r — 2A 0 Ao(3t sin 3t 

C = F cos” /3 t — Ao Ao sin 2 /3r — AoA q @~t~ 

When r is near n , is approximately 7r. Hence both C B and C — B 
are approximately — A 0 A oV and are of the same order of magnitude. Con¬ 
sequently M 22 and A /23 are both nearly equal and 

M73 — 'poiC 4 ~ B\ 

— a' 1 \ n 2 

— — A$ A Q TT 

When this expression for A /23 is used our approximation to (3.4-1) gives 
us the result: If the correlation function is of the form 


1 p T — A COS (3t 


where A is a slowly varying function of r, the probability that the distance 
between two successive zeros lies between r ^nd r -f- dr is approximately 


dr a 

2 [1 + a*(r - n) 2 ] 3/2 


where a is positive and 



A oP 

2 , 

— AqTi 



7 r 



For our ideal band pass filter with the pass band/*, — f a , 


a = V3 

Jb Ja 


1 


r 1 = 


Jb + fc 


and the average value of | r — n | is a l . Thus 


ave. t — ti 

T\ 


1 _ Jb — fa _ 1_ band width 

ar i \/3 (/& 4- /a) 2\/3 mid-frequency 


When the correlation function cannot be put in the form assumed above 
but still behaves like a sinusoidal wave with slowly varying amplitude we 
may use our first approximation to (3.4-1). Thus, the probability that the 
distance between two successive zeros lies between r and r -j- Jr is approxi¬ 
mately 

bdr 

l+l ~ * 2 4 3/2 


when r lies near n where n is the smallest value of r which makes \p T 
approximately equal to — \po. This probability is supposed to approach 
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zero rapidly as r departs from n , and b is chosen so that the integral over 
the effective region around n is unity. 

It seems to be especially difficult to get an expression for the distribution 

of zeros for large spacing. One method, suggested by Prof. Goudsmit, is 

to amend the conditions leading to (3.4-1) by adding conditions that I be 

positive at equally spaced points along the time axis between 0 and t. 

I his leads to integrals which are hard to evaluate. For one point between 
0 and r the integral is of the form (3.5-7). 

Another method of approach is to use the method of “in and exclusion” 
of zeros between 0 and r. Consider the class of curves of / having a zero 
at r = 0. Then, in theory, our methods will allow us to compute the func¬ 
tions po(r), p\{r, r), p 2 (r, s , r), associated with this class where 
Po(t) dr is probability of curve having zero in dr 
P\{r, T ) dr dr is probability of curve having zeros in dr and dr 
pi(r, s, t) dr dr ds is probability of curve having zeros in dr, dr, and ds 
In fact po(r) dr is expression (3.4-10). The method of in and exclusion 
then leads to an expression for P 0 ( T ) dr ,.the probability of having a zero 
at 0 and a zero in r, r -f- dr but none between 0 and r. It is 



dr+ - 
2 ! 


f / Pz( r J s, t ) dr ds 
0 Jo 




, s t t, t) dr ds dt + . 


(3.4-11) 


Here again we run into difficult integrals. Incidentally, (3.4-11) may be 
checked for events occurring independently at random. Thus if v dr is 
the probability of an event happening in dr, then, if v is a constant and the 
events are independent, we have p 0 , p x , p 2 , ... given by v, v , */ 3 , • • • . 
From (3.4-11) we obtain the known result Po(t) = ve~ VT . 

\\ e shall now derive (3.4—1). I he work is based upon a generalization of 
(3.3-5): If y is a random curve described by (3.3-1), the probability that y 
will pass through zero in a‘i , -f- dxi with a positive slope and through 

zero in x 2 , x 2 + dx 2 with a negative slope is 

—dxidx 2 f drji f drj 2 rjirj 2 p(0, rji , X\; 0 , rj 2f x 2 ) ( 3 . 4 - 12 ) 

•'0 •'—oo 



where p(£i , rji , X\ ; & , tj 2 , x 2 ) is the probability density function for the 
four random variables 


& = , 0, N \ Xi) 



i = 1, 2. 


r 



The xi and x 2 play the role of parameters in (3.4-12). This result may be 
established in much the same way as (3.3-5). 

When we identify F with one of our representations, (2.8-1) or (2.8-6), 
of the noise current /(/) it is seen that p is normal in four dimensions. We 
may obtain the second moments directly from this representation, as has 
been done in the equations just below (3.3-7). The same results may be 
obtained from the definition of ^(r), and for the sake of variety we choose 
this second method. We set xi = t\ , .v 2 = t\ -f r. Then 

1? =11 = W) = V^o 


£l£> = -hr) = \pr 

— 7d/\7aA . . 1 r T 

v>rn = WMaoL = hr T J 0 V(i + dt 


(3.4-13) 


where primes denote differentiation with respect to the arguments. Inte¬ 
grating by parts: 


l r( ~ l + T) dI< ‘> = [*'(* + O/WJ 0 - f I"(t + T)I(t) dt 

Jo 

We assume that / and its derivative remains finite so that the integrated 

' T, in the limit. Since 

r'(‘ + r) = f ? I(t + r) 

we have 


^ i / \ . // 

771 772 ~~ ~dr 2 ^ = ~^ r 

Setting r = 0 gives 

”2 _ ~2 n 

Vi — V 2 = — l/'O 

in agreement with the value of M22 obtained from (3 3-7) 
way 


In the same 


fc* = hr t L V{1 + t)/( ° dt = t 

= tr 

— i r T 

hvi = Limit - / /'(/)/(/ + T ) dt 

T —*ao 1 JO 

~ jf I\t -f* r)I(t) dt 
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where we have integrated by parts in getting £ 2 >?i • Setting r = 0 and using 
= 0 gives 



In order to obtain the matrix M of the second moments in a form 
fairly symmetrical about its center we choose the 1, 2, 3, 4 order of our 
variables to be £i , 771 , rj 2 , £2 . From equations (3.4-13) etc. it is seen that 
this choice leads to the expression (3.4-2) for M. 

When we put £1 and £2 equal to zero, we obtain for the probability density 
function in (3.4-12) the expression 



(M 22 VI + 2M23 7Jl7]2 + M 33 V 2 ) 



Because of the symmetry of M, M 22 is equal to M 33 . When, in the integral 
(3.4-12) we make the change of variable 

r 3/22 T /2 T 3/22 T /2 

* = \_2\JT IJ 7,1 ’ y= 'l2\M\\ m 

we obtain 

dxidxi 1 mi 1 ? r xdx r dy 

7 r 2 M 22 Jo Jo 


The double integral may be evaluated by (3.5-4). Let 



cot 1 (—//), 



where H is the same as that given in (3.4-2). Our expression now becomes 


d Xl 1 m r 


2 [1 + H cot" 1 (-H)] 


47T 2 3/ 22 — 3/ 23 


From a property of determinants 

MvM 33 - Ml 3 = I M I - +\) 


Using this to eliminate | M | and dividing by 

dx 1 [ -tol 112 

2tt L to J 


which, from (3.3-10), is the probability of going through zero in x, , x, -f- dx 1 
with positive slope, gives the probability of going through zero in dx 2 with 
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r 


2 


negative slope when it is known that I goes through zero at x\ with positive 
slope: 

P RJ'W - Mim - ^r 3,2 [i + h cot- (-id} 

2 7T L “WO J 

This is the same as (3.4-1). 

The expression (3.4-10) is the same as the probability of I going through 
zero in dr when it is known that / goes through zero at the origin with posi¬ 
tive slope. This second probability may be obtained from (3.4-1) by add¬ 
ing the probability that I goes through dr with positive slope when it is 
known to go through zero with positive slope. Thus we must add the ex¬ 
pression containing the integral in which the integration in both 77 ! and 772 
run from 0 to cc . In terms of x and y this integral is 

[ xdx 

Jo 

This is equivalent to a change in the sign of .IA 3 and hence of //. After 
this addition we must consider 

1 + 11 cor 1 (-//) + 1 - 11 cot- // 

= 2 + 11 [cot -1 (-11) - cor 1 II] 

— 2 + U[t — 2 cor 1 II] 

= 2[1 + II tan -1 77] 
and this leads to (3.4-10). 


1 


ao 


dy ye 


— X 


2 _ ,.2 _ 


V 1 2 ( Af 2 3 / . 1 / 2 2 > x V 


3.5 Multiple Integrals 
We wish to evaluate integrals of the form 

dx 1 




(3.5-1) 


Our method of procedure is to first reduce the exponent to the sum of 
squares by a suitable linear change of variable and then change to polar 
coordinates. This method appears to work also for triple integrals of the 

same sort, but when it is applied to a four-fold integral, the last integration 
apparently cannot be put in closed form. 

The reduction of the exponent to the sum of squares is based upon the 
transformation: If* 


X\ — h x yi -f hvD 2l y 2 + h z D n y z -}-••• -f- h n D n ,iy n 

Xi = 0 + h 2 D m y 2 + ... + h n D n ,i y n (3.5-2) 


= 0 


+ 0 


+ 


-f 0 + h n D n , n y n 


Theory 





where Do — 1 , D\ — #n , D r , r = D r ~\ , and Z> ra is the cofactor of a tr (or 
of a r » because they are equal) in D r : 




#n 

#12 * * 

* #lr 

D r = 

#12 

#22 



#lr 

• • • 

#rr 


h r = [DrM~ ll \ 


then, if none of the Dr s is zero, 

n 

£r« £r Xt = yi + y2 + • • * + y n 


From (3.5-2); the Jacobian d(xi , • • • x n )/d(yi , • • • y„) is equal to Z> n 1/2 . 
Applying our transformation to the exponent: 

xi = yi — aD2 ll2 y2 
& = 0 + DJ 1,2 y2 
D 2 = 1 — a 


Since x 2 runs from 0 to « so must y 2 . The expression for x\ shows that yj 
runs from a D 2 1/2 y 2 to co. The integral is therefore 


J = DT 112 [ dy 2 f 

JO Ja D - 1 / 


e - v2 - V t d yi 


1/2 


We now change to polar coordinates: 


yi = p cos 6 
y 2 = P sin 6 


dyi dy 2 = p dp dQ 


y 2 > 0 gives 0 < 0 < ir 

yi > aD 2 1,2 y 2 gives cot 0 > aD F 1/2 


and obtain 


-«“ i. 


cot 1 aD, 1/2 


<*0 


pe p dp 


= jz>r 1/2 cot -1 (az?r 1/2 ) 

where the arc-cotangent lies between 0 and tt. This may be written in the 
simpler form 

J — £(1 — # 2 )“ 1/2 cos -1 a = esc <p 

where 

a — cos <p, 

* 

it being understood that 0 < <p < ir. 
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Other integrals may be obtained by differentiation. Thus from 


f dx f ^ esc 

Jo Jo 


(3.5-3) 


we obtain 


J dx J dy xy e **’ 2r 


—x* — y l ~2xy cos * _ \ 


= 4 esc" if (1 — cot (3.5-4) 


By using the same transformation we may obtain 


oo *ao 


f dx f dy ye~ x *~ vl 

Jo Jo 


— — 2 aiy 


\/ 7T 1 

4 1+a 


(3.5-5) 


Of course, we may expand part of the exponential in a power series and 
integrate termwise but this leads to a series which has to be summed in each 
particular case: 



n m 

x y 


—z* — y*—2ax y 

V 



r ( « . + ; + ■ ) r 


If we take 1 < R(m) < — — 1 < R(m) < — J, the series may be 

summed when a = 1. The result stated just below equation (3.8-9) is ob¬ 
tained by continuing m and n analytically. 

The same methods will work when the limits are ± °c. We obtain, when 
m and n are integers, 


£ +00 m +oo 

dx / dy 

00 J-tf, 


x n y m e ~ **-y 2 -2ry cos <p 


fo, 


n -f- m odd 

m -f- 






(sin <p) n+m+1 

( 1 — n 

\ H ’ m ’ 2 


— n — m 


(3.5-6) 


1 — COS <p\ 

2 /’ 


n - r m even 


The hypergeometric function may also be written as 
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By transformations of this we are led to the following expression for the 
integral 

0, n + m odd, 

V / V 

m + 


/m+l\ /« + l\ 

\ 2 \ 2 K( n ml 2 \ ... 

——— . .J.. -- F — - , — - , - ; cos ip J, tn.n both 

(sin ip) n+m + l \ 2 2 2 v 1 


even, 


-2 



r i + ^ r l + 



(sin <p) 


n+m+1 


_ — m 1 — n 3 2 

cos ipF —— , —-— ; -; cos 




m , ft odd 

As was mentioned earlier, the method used to evaluate the double inte¬ 
grals may also be applied to similar triple integrals. Here we state two 
results obtained in this way. 


/ dx dy dz exp [—x 2 — y — z — lexy — 2bzx — 2 ayz] 
Jo Jo Jo 




+ 0 + 7 — 7r] 


£ dx J dy J dz yz exp [— x — y — z — 2 cxy — 2 bzx — 2 ayz) 


_ y/ 7r 1 + a. — b 

~ SD 3 L 1 + a 


— b — c 


a 1,2° (<* + 0 + 7 


D 


8 


->] 


(3.5-7) 


where 0 and y are obtained by cyclic permutation of a , b, c from 


a = cos 


-l 


a — cb 


(1 - c 2 ) 1/2 (l “ &) 


1/2 


* [iT= 


Dz 


c 2 )( 1 


- * 2 )] 


1/2 


_ x a — be 
= cot 


2 _2 


= 1 + 2 abc - a - b d - c 


where a, 0 , 7 all lie in the range 0 , n and where 

1 c b 
Dz = c 1 a 
b a 1 

For reference we state the integrals which arise from the definition of the 
normal distribution given in section (2.9) 

C d “- C *•«»[-? -**] - 


n “11/2 


£ dx 1 '" £ dx n x t x u exp f—S x rX, = 


(3.5-8) 


tu 
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where the quadratic form is positive definite and | a j is its determinant. 
A t u is the cofactor of a lu . Incidentally, these may be regarded as special 
cases of 






n 


^ ; .1 re b r b B 


a 


1/2 


(3.5-9) 


which is a generalization of a result given by Schlomilch.* 


3.6 Distribution- of Maxima of Noise Current 

Here we shall use a result similar to those used in sections 3.3 and 3.4. Let 
y be a random curve given by (3.3-1 j, 

y = F\a i • • • a y ; x). (3.3-1) 

If suitable conditions are satisfied, the probability that y has a maximum in 
the rectangle (xi , X\ -f- dx\ , y\ , y\ + dyi), d .it and dy i being of the same 
order of magnitude, is 32 

-dx, dyi [ p( yi , 0, r)r d$ (3.6-1) 

•*—00 

and the expected number of maxima of y in a < x < b is obtained by in¬ 
tegrating this expression over the range — oo < y l < zc , a < xi < b. 
V, f) is the probability density function for the random variables 


£ = F(<*i > jOy ;x i) 



(3.6-2) 



* Hohcren Analysis, Braunschweig (1879), Vol. 2, p. 494, equ. (29). 

F i n 1 iuT’ Voi 61 0939) 409-416. A similar problem has been studied by 
E L. Dodd, The Length of the Cycles VV hich Result From the Graduation of Chance 
Elemen s, Ann. Math. Stat Vol. 10 (1939) 254-264. He gives a number of references 
to the literature dealing with the fluctuations of time series. 




In our application of this result we replace * and y by t and 1 as before. 
Then 




v = r 

r = i" 

where the primes denote differentiation with respect to t. According to the 
central limit theorem the distribution of £, rj , £ approaches a normal law. 
The second moments defining this law may be obtained either from the 
above definitions of £, rj, £*, or may be obtained from the correlation function 
as was done in the work following equation (3.4-13). 

f 2 = to, v 2 = — to , £77 = 0 

= /'(/)/"(/) = Limit i f T /'(/)/"(/) 


= Limit -t [/ ,2 (D - / ,2 (0)] = 0 

r—oo 

If = Limit i f T I(t)I"(t) dt 

T —*oo i •'O 

T • •• d 2 ^(r) // 

= Limit — v = ^0 

T -*o dr 2 

F 2 = Limit i r rrw dt 

T—OO 1 Jo 

= Limit 1 [ T I m (t)I(t) dt 

T—oo 1 JO 


where the superscript (4) represents the fourth derivative. The matrix M 
of the moments is thus 


M = 


to 

0 

to 


0 


-to' 0 


1 " 

r 0 


0 V^o 4) _ 


The determinant I M I and the cofactors of interest are 



(3.6-3) 


2 


The probability density function in (3.6-1) is 


/>(/, o, r) = ( 2 tt) 


-3/2 


M 


- 1/2 


exp 


[~ 2 ~V| (Afll/t + Mu ? + 2A/u/ rtJ 


(3.6-4) 


and when this is put in (3.6-1) and the integration with respect to f per¬ 
formed we get 


d i <ii <*>"" r i ^ 

M. 33 L 


1/2 

V 


+-' UJ •-.. 


1 -f- erf 


[2 |M| 


“L_Y1 

1/2 /J 


(3.6-5) 


for the probability of a maximum occurring in the rectangle di dt. .As is 
mentioned just below expression (3.6-1), the expected number of maxima 
in the interval t\ , t 2 may be obtained by integrating (3.6-1) from t\ to t 2 
after replacing x by /, and 7 from — x to + x after replacing y by I . When 
we use (3.6-4) it is easier to integrate with respect to 7 first. The expected 
number is then 




MTV 

2 n 


r exp 


[- 


r 

2 Af 


(- - S )1 


dt 


I (4) 

(<2 ~ h)jh- Mn m 

27r 


^2 

27T 


<i r ^o 4) t 2 

L-*"- 


Hence the expected number of maxima per second is 


1 [ T /2 _ 

2* L-^'J 


_ fl A(/) d *\ 


[ Mf)df 

J 0 


(3.6-6) 


For a band pass filter, the expected number of maxima per second is 


[3 A -X] 

Lsy? -fA 


(3.6-7) 


where ft and /„ are the cut-off frequencies. Putting /„ = 0 so as to get a 
low pass filter, 


ET - ■' 


75f t 


(3.6-8) 



I 


From (3.6 8) and (3.6-5) we may obtain the probability density function 

for the maxima in the case of a low pass filter. Thus the probability that 

a maximum selected at random from the universe of maxima will lie in 
I, I + dl is 



Fig. 2—Distribution of maxima of noise current. Noise through ideal low-pass filter. 
pi{y) 

^y==. dl =? probability that a maximum of / selected at random lies between / and I + dl. 


When y is large and positive (3.6-9) is given asymptotically by 


dl_ \/5 
y/'P o 3 



If we write (3.6-9) as pi(y) dy, the probability density pi(y) of y may be 
plotted as a function of y. This plot is shown in Fig. 2. The distribution 
function P(I max < yvVo) defined by 


P(/max < y\fpo) = [ pi(y)-dy 

J— QO 


and which gives the probability that a maximum selected at random is 
less than a specified y\/\p 0 = /, is one of the four curves plotted in Fig. 4. 

If I is large and positive we may obtain an approximation from (3.6-5). 
We observe that 


Mn = ^ 4) > 1 

| M | — to 2 ^0 
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so that when / is large and positive 

e -MuJ*l2\M\ ^ ~l*Mo 

Also, in these circumstances the 1 -T erf is nearly equal to two. Thus re¬ 
taining only the important terms and using the definitions of the M’s gives 
the approximation to (3.6-5): 

dl dt ["-*/• 

L \p 0 

From this it follows that the expected number of maxima per second lying 
above the line I — 1 1 is approximately 33 when /1 is large, 

2’ r L 'Po J (3.6-11) 

2 

_ e -i x iWo y i[the expected number of zeros of I per second] 

It is interesting to note that the approximation (3.6-11) for the expected 
number of maxima above h is the same as the exact expression (3.3-14) for 
the expected number of times I will pass through I\ with positive slope. 


"ni/2 


Ie 


-I* Mo 


(3.6-10) 


3.7 Results on the Envelope of the Noise Current 


The noise current flowing in the output of a relatively narrow band pass 

filter has the character of a sine wave of, roughly, the midband frequency 

whose amplitude fluctuates irregularly, the rapidity of fluctuation being 

of the order of the band width. Here we studv the fluctuations of the 

* 

envelope of such a wave. 

First we define the envelope. Let f m be a representative midband fre¬ 
quency. Then if 


co m = 2-rrfm 

the noise current may be represented, see (2.8-6), by 

I = ^2 c n COS (a>„ t — Umt — <pn 4- w m /) 

n—1 


= I c COS 0) m t — I, sin co m t 
where the components I c and I, are 

N 

Ic = ^ ^ C n COS (w n / CO m t {f n ) 

n—1 

AT 

I • = ^ ^ Cn sin (o) n t C C m t *Pn) 

n—1 


(3.7-1) 


(3.7-2) 


(3.7-3) 


53 This expression agrees with an estimate made by V. D. Landon, Proc. I. R. E., 29 
(1941), 50-55. He discusses the number of crests exceeding four times the r.m.s. value 
of 7. This corresponds to 1\ = 16^ 0 . 


81 


The envelope, R , is a function of t defined by 

R = [II + II) 1 ' 2 (3.7-4) 

It follows from the central limit theorem and the definitions (3.7-3) of I e 

and T s that these are_two normally distributed random variables. They are 

independent since I c I a = 0. They both have the same standard deviation, 
namely the square root of 


f 2 c = II = I 2 = [ w(f ) df = \pQ (3.7-5) 

JO 

Consequently, the probability that the point ( I e , I.) lies within the ele- 
mentary rectangle dlcdl 3 is 



In much of the following work it is convenient to introduce another ran¬ 
dom variable 0 where 


I e = R cos 0 
I, = R sin 0 


(3.7-7) 


Since I c and I a are random variables so are R and 6 . The differentials are 
related by 

dlcdl a = RdddR (3.7-8) 

and the distribution function for R and 6 is obtainable from (3.7-6) when 
the change of variables is made: 


d6_ RdR ^-Riwo 

2tt \J/ 0 


(3.7-9) 


Since this may be expressed as a product of terms involving R only and 0 
only, R and 0 are independent random variables, 0 being uniformly dis¬ 
tributed over the range 0 to 2tt and R having the probability density 34 


R -ft 2 /2* 0 

\po 


(3.7-10) 


Expression (3.7-10) gives the probability density for the value of the en¬ 
velope. Like the normal law for the instantaneous value of /, it depends 
only upon the average total power 

lAo = [ w(J) df 
jo 

34 See V. D. Landon and K. A. Norton, I.R.E. Proc., 30 (1942), 425-429. 
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We now study the correlation between R at time t and its value at some 
later time t -f- r. Let the subscripts 1 and 2 refer to the times t and t -f- r, 
respectively. Then from (3.7-3) and the central limit theorem it follows 
that the four random variables I c i , hi , hi , hi have a four dimensional 
normal distribution. This distribution is determined by the second mo¬ 
ments 



c2 




— hi — hi — I al — to — ^11 
hi hi ~ hi hi = 0 

Cn COS (u) n T “ CU m r) 


[ w(f) cos 2?r(/ - / m )r 6// = M 13 


(3.7-11) 


hi hi — 


_ | V 

hlhl ~ sin (o) n T U) m T ) 

Z n—1 


*»(/) sin 2ir(/ - /„)r <// = M i« 

•'O 


The moment matrix for the variables in the order hi , hi , Id , 7.2 is 



to 

0 

M13 

M14 

M = 

0 

to 

— M14 

Ml3 

M13 

— M14 

to 

0 


_M14 

Ml3 

0 

to 


and from this it follows that the cofactors of the determinant I M I are 


Tfn — M 22 — A /33 — A/« = Mto — M 13 — Mu) 



(3.7-12) 


M12 = A/34 = 0 

A/j 3 = A/ 2 4 = —/113-4 

A/14 = — A /23 = —Ml 4^4 
| A/ I = A 2 


The probability density of the four random variables is therefore 


iii exp - 


1 

2 A 


[Mil + l\ + 




~ 2 Mhh + hh) - 2mi4(/i/ 4 - I 2 h)] 
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where we have written h,I 2 ,I s , I, for I cl , I tl , , 7. 2 . We now 

the transformation 


Ii = Ri cos 0i / 3 = _K 2 cos 

/ 2 = -Ri sin 0i / 4 = i? 2 sin 0 2 

and average the resulting probability density over 0 2 and 0 2 in order to get 
the probability that R x and R 2 lie in dR x and dR 2 . It is 

R\ R 2 dR\ dR 2 


4t t 2 A 


r * / 


2r 


1 


2^ l^oRi + toRi — 2^uR\R 2 cos (0 2 — 0i) — 2imRiR 2 sin (0 2 — 0j)] 


Since the integrand is a periodic function of 0 2 we may integrate from 
0 2 = 0i to 0 2 = 0i + 2tt instead of from 0 to 2tt. This integration gives the 
Bessel function, Iq , of the first kind with imaginary argument. The result¬ 
ing probability density for Ri and R 2 is 

^ /o [„*, + exp - £ (1 + Rl) (3.7-13) 

where, from (3.7-12), 

j ,2 2 2 

A = Vo — Mi3 — Mu 

Mi3 and mh are given by (3.7-11). Of course, Ri and R 2 are always positive. 
For an ideal band pass filter with cut-offs at f a and fb we set 

fm , ^C/) = Wo for fa < f < fb 

and obtain 


ypo = wo(fb — fa) 


Ml3 



Wp sin tt(/ 6 — /q)r 
7rr 


rfb 

Mi4 = / Wo sin 27 t(/ — / m )r df = 0 

J fa 


The 7o term in (3.7-13), which furnishes the correlation between R\ and R 2 , 
becomes 
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where x is x (fb — f a )r . When x is a multiple of x, R\ and R 2 are independent 
random variables. When x is zero Ri and R 2 are equal. Hence we may 
say, roughly, that the period of fluctuation of R is the time it takes x to in¬ 
crease from 0 to x or (fb — f a )~ l . This is related to the result given in the 
next section, namely that the expected number of maxima of the envelope 
is .641 (fb — f a ) per second. 


3.8 Maxima of R 


Here we wish to study the distribution of the maxima of R.* 
is based upon the expression, cf. (3.6-1), 


Our work 


-dRdt [ p(R,0, R")R" dR 

30 


ft 


(3.8-1) 


for the probability that a maximum of R falls within the elementary rec¬ 
tangle dR dt. p(R , R' } R") is the probability density for the three dimen¬ 
sional distribution of R, R ', R" where the primes denote differentiation with 
respect to /. 

\\e shall determine p(R , R\ R") from the probability density of I c , l\ , 
l c , h , I c , I* , which we shall denote by xi , x 2 , • • • .r 6 . The interchange 
of I a and I c is suggested by the later work. It is convenient to introduce 
the notation 




**(/)(/ - /«)" df 



(3.8-2) 


where f m is the mid-band frequency, i.e., the frequency chosen in the defini¬ 
tion of the envelope R. b n is seen to be analogous to the derivatives of 
\p(r) at r = 0. 

Irom the definitions (3.7-3) of I c and /« we obtain the second moments 

2 2 

Xi = I c = \po = bo 

xi = m = *o 


xl = I? = z ^(/„)A/4 tt 2 (/„ - f m ) 2 = b 2 

1 



nf thl n ^ah?rf lly, f mOSt of th ^ anal > si j of this section was originallv developed in a study 
of the stability of repeaters in a loaded telephone transmission line. The envelope R 

Hn S wp S v S p°r C1 fh ed \ h n ^turned current” produced by reflections from line irregularities 

^ , fdl Short -° f ll , S 0bject and the onl >- ^sults which seemed worth sab 

v aging at the time were given in reference 25 cited in Section 3.3. 




N 


X! Xi = I c i', = X) w(f n )Af2r(f n - f m ) = 4i 




= IX = - 4 , 


iV 


*1*3 = 


IX: = -I>(/)A/4x 2 (/ n -/ m ) 2 = -4 


* 4*6 = Itl" = —5 


*2*3 = 


*5*6 = 


/: r: 
rx: 


— bz 

bz 


All of the other second moments are zero. 


The moment matrix M is thus 



The adjoint matrix is 




Bo 

Bi 

-Bo 

0 



Bi 

B 22 — B$ 

0 



-B 2 - 

-Bz 

B\ 

0 



0 

0 

0 

Bo 



0 

0 

0 

-B x 



0 

0 

0 

-b 2 

B a -- 

— 

(b 2 bi 

- b\)B 

b 22 

B 1 - 

= 

- (bib, 

— b 2 bz)B 

Bz 

Bo -- 

= 

(bob. 

- b\)B 

B\ 




(bobz — bib?)B 
( 4 o 4 2 - b\)B 


B = bob 2 b A -j- 2 b\b 2 bz 



( 3 . 8 - 3 ) 


| M | = B 2 


where B is the determinant of the third order matrices in the upper left and 
lower right corners of M. 

As in the earlier work, the distribution of x x , • • • , * 6 is normal in six 
dimensions. The exponent is — [2 | M | ] 1 times 

-6o(*i + x\) + 2B 1 (x 1 x 2 — XiX 6 ) — 2B 2 (xiXz + *4*e) 

+ B 22 (xl + *b) — 2B i (x 2 x 3 — x b xe) (3.8-4) 

■+■ B A {x\ + x\) 
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21 ! 



In line with the earlier work we set 

Xi — I c = R cos 0 xa = I, = R sin 0 

a* 2 = l' a = R' sin 0 R cos 00' 

3*6 — l'e — R' cos 0 — i? sin 00' 

3*3 = l'J = R" cos 0 — 21?' sin 00' 

— R cos 00' 2 — R sin 00" 

3*« = i” = R" sin 6 + 2R f cos 00' 

- K sin 00 /2 + cos 00" 

The angle 0 varies from 0 to 27r and 0' and 0" vary from — oo to -f oo . By 
forming the Jacobian it may be shown that 

dx\ dx 2 • • • dxt = R 3 dR" d6 dd' d6 " 

Also, the quantities in (3.8-4) are 

x] + xl = R 2 *, * s + *, = - R 2 6 ' 2 

^1 ^2 - * 4*5 = *2 + *6 = i ?' 2 + 7 ? 2 S ' 2 

*2*3 - *6*e = RR"0’ - 2R' 2 e' - - i? 2 0 ' 3 

*3 + *6 = R" 2 — 2 RR"8’ 2 + 4 R' 2 8’ 2 + 4 RR’6‘8" 

+ R 2 8' t + R 2 B" 2 

The expression for p(R, 0, R") is obtained when we set these values of the 

* s in (3.8-4) and integrate the resulting probability density over the ranges 
of 8, S', 8": 

**•»■ *"> - St r * c «• l ~ jt " <«-« 

fiXp ~Tni [BaR2 + 2 b iR 2 8’ - 2B 2 (RR" - J? 2 0 


+ B 22 R 2 8' 2 - 2B 3 R8'{R" - R8' 2 ) 


+ B t {R" 2 - 2 RR"8' 2 + R 2 ?* + R 2 e" 2 )] 

T! p i n te I^ ti ° nS Wkh r6SpeCt t0 6 and 9 " ma >’ be Performed at once leaving 

f n TT 1 35 a SinglC intCgral Whkh ’ unf °rtunately, appears to 

be difficult to handle. For this reason we assume that w(f) is symmetrical 

about the mid-band frequency f m From (3 8-?') h A h 

f rn m n n a v y J * 0i and 03 are zero and 

trom (3.8 3), and B$ are zero. 
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With this assumption (3.8-5) yields 


p(R, 0, R") = R\27r)~ 312 BT ut [+* dd' 

j— 00 


(3.8-6) 


1 


exp ~ 2 F ‘ [BoR2 + R([B22 + 2B ^ Re ' 2 ~ 2B * R ") + B *( R " ~ Re ' 2 ) 2 ] 

The probability that a maximum occurs in the elementary rectangle dR 
dt is, from (3.8-1), p(t , R) dR dt where 


p(t,R) = -f° p(R,.0, R")R" dR 

*L—oo 


// 


(3.8-7) 


We put (3.8-6) in this expression and make the following change of variables 


x = 


B\ 


1/2 


Rd' 2 , 


V2B 


B 




y/lB^B 


R - 


y = 


*2 


V2B< 


r 1/2 

R" 

V2 B 


R 


(3.8-8) 


b = - 


(By + 2 B 2 ) 
2 B b\ 


r 3 io&ti ! 2 *. 

= U-aiJ- l(3 ' a) 


2 B 0 2 Bi 

a = 


2B 2 b\ 


bob\ 


where \ve have used the expressions for the B’s obtained by setting £1 and 
bz to zero in (3.8-3). Thus 


*'• R) - (I")’" L ydy L x 


— 1/2 


dx 


(3.8-9) 


exp [ — a z + 2bzx + 2 zy — (x + y) ] 

As was to be expected, this expression shows that p{t, R) is independent of t. 

A series for />(/, R) may be obtained by expanding exp 2 s(y + bx) and 
then integrating termwise. We use 


[ dy f dxx^v'e 
Jo Jo 


y -( x +„) 2 _ 


y/ 7 r r(7 -T 1 )T(m + 1) 


2*+7+2 



+ 7 + 3 


which may be evaluated by setting 


2 2 

x = p cos (p , 


2 • 2 

y = p sin <p 
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The double integral in (3.S-9) becomes 


—a 2 


* 2 /v (2 z) n F(w £)T(« — m + 2) 

f/ 2 r.-o n\ m -ow!(« — m)! 


where = 1 and 


1 _ y' (illi' ' ‘' ( ;w ~ 2) / 

A n - 2^ -j- (n 

m- 0 ;w! 


r - 4- 



= *2“ 6 ' 2 £ -i 


cc n —a 2 * 2 

2 e 


n«0 


7 \ A 

r (i + 0 


m + 1)6™, 0 < n (3.8-10) 


A n 


(« + i)d - tr 1 “ - " a - *r 3/2 

2 


« large 


The term corresponding to m — 0 in (3.8-10) is n -f 1. 
We thus obtain 


-a 2 i 2 


pu, R) = wr ± * A 

4 Mi V* "-0 r + 7 \ " 


-a 2 , 2 ,1/2 
c "2/2 


(3.8-11) 


4\/ it bo 


(a - 1 ) 


3/2 _ 3/2 


CO 


Z 


71 A 

2 


r (. + A 


We are interested in the expected number, N, of maxima per second 
From the similar work for /, it follows that .V is the coefficient of dt when 
(3.8-1) is integrated with respect to R from 0 to * . Thus from (3.8-7) and 

dR = 



4 bz dz = (26o5) 1/2 6F 3 ' 2 dz 


= [26 0 (a 2 - \)] m dz 


we find 


V = / P(t, R) 


dR 


_ (* 2 - 1) 


(2a) 


6/2 


Y" £ 1 V 2 + f) A. 

n "° „ (n . 7\ a n 


(3.8-12) 


+ 4 


tha E t q , U m° r ' S (3 - 8 - n ^" d ,(3.8-12) have been derived on the assumption 
that w(f) is symmetrical about f m , i.e. the band pass filter attenuation is 


8Q 


1 2 2 2 

symmetrical about the mid-band frequency. We now go a step further and 
assume an ideal band pass filter: 

Hf) = W 0 fa <} <fb 

w(J) = 0 otherwise (3.8-13) 

2/m = fa + f b 

Putting these in (3.8-2) we obtain zero for b\ and bz and also 


bo = w 0 (f b — fa) = \p 0 

L _ ^0 / r t \3 

02 -(/& — fa) 



7T 4 Wo 

~5~ 


(/» - fay 




§(3 - a 2 ) = I 


i? = [2ic(a 2 - 1)] I/2 Z = [f*„] 1/2 Z 



r^n i/2 

jJ (f»~fa), 


2 2 
a z 



/In W /In 

1 4 6.775 

2.3 5 8.333 

3.735 6 9.9002 

5.238 7 11.4736 

~ 1.5811 n + .3953 


9R 2 

8^0 


(3.8-14) 


From (3.8-12) we find that the expected number of maxima per second 
of the envelope is 


N = .64110 (f b - f a ) 


(3.8-15) 


assuming an ideal band pass filter. 

The distribution of the maxima of R for an ideal band pass filter may be 
obtained by placing the results of (3.8-14) in (3.8-11). This gives 


p{t y R) dR 


dR (f b - fa) 
*1" 4 



—a 2 * 2 

e 
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It is convenient to define v as the ratio 

* 


R 

r.m.s. /(/) 




where R is understood to correspond to a maximum of the envelope. Since 
the value of R corresponding to a maximum of the envelope selected at 
random is a random variable, y is also a random variable. Its probability 
density is p R (y) t where 


p R {y) dy = 


/>(/, R) dR 

0.64110(/b - f a ) 


pn{y) has been computed and is plotted as a function of y in Fig. 3. 



The distribution function P(R ma x < yVVo) defined by 

R(Rmax < y\/iAo) = f p R {y) dy 

Jo 

and which gives the probability that a maximum of the envelope selected 
at random is less than a specified value yvVo = R, is plotted in Fig. 4 to- 
gether with other curves of the same nature. 
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When y is large, say greater than 2.5, 


99.99 


99.95 
99 9 


99.6 


99 5 


A 


p R (y) ~ —- (y 

y .64110 


- l)e 


-V 2 /2 


P(Rmax < y VVo) 


A 

64110 


ye 


V 2 /2 


















= NOISE CURRENT - LOW PASS FILTER 




NOISE CURRENT ENVELOPE - 
BAND PASS FILTER 

RMS NOISE CURRENT 



Fig. 4—Distribution of maxima 

A — P{I < yy/~4'a) = probability of / being less than yy/\f/ Q . Similarly C = P(R < 

yVto ). 

B = P(I max < y\Afo) = probability of random maximum of / being less than yy/yj/* . 
Similarly D = P(R max < yVTo). 






2 


The asymptotic expression for pn(y) may be obtained from the integral 
(3.8-9) for p{t , R). Indeed, replacing the variables of integration x, y in 
(3.8-9) by 

= x 

/ = * + y, 

integrating a portion of the y' integral by parts, and assuming b < 1 
(a~ > 1, by Schwarz’s inequality, so that b < 1 always) leads to 

> 

’/'o Wo 


Pit, R) 






when R is large. 

If, instead of an ideal band pass filter, we assume that nif) is given by 

1 . 

f,n » cr (3.8-16) 


»(/) = 

O'v 2 7T 


we find that 


bn — 1 


bo — 47 r 2 a 2 


bi = 167T 4 ‘3cr 4 

a 2 = 3, b = 0 
-4 n = (w *+• 1) 

Some rough work indicates that the sum of the series in (3.8-12) is near 
3.97. This gives the expected number of maxima of the envelope as 

N = 2.52cr (3.8-17) 

per second. 

The pass band is determined by a. It appears difficult to compare this 
with an ideal band pass filter. If we use the fact that the filter given by 


w 




passes the same average amount of power as does an ideal band pass filter 
whose pass band is /*, — f a , we have 

fb — fa = (t\Z2tt 

and the expression for A r becomes 1.006 ( f b - f a ). 

3.9 Energy Fluctuation 

Some information regarding the statistical behavior of the random vari¬ 


able 


/ 


*i+r 


I\t ) dt 
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(3.9-1) 


’226 


where I(t) is a noise current and 1 1 is chosen at random, has been given in a 
recent article. 30 Here we study this behavior from a somewhat different 
point of view. 

If we agree to use the representations (2.8-1) or (2.8-6) we may write, as 
in the paper, the random variable E as 

/ 772 

I\t) dt (3.9-2) 

772 

where the randomness on the right is due either to the a n ’s and b n ’s if (2.8-1) 
is used or to the «^ n ’s if (2.8-6) is used. 

The average value of E is m T where, from (3.1-2), 

rTI 2 _ -772 

E = m T = / P(t) dt = / *(0) dt = Tf 0 

J—T/2 J—T/2 

„ (3.9-3) 

-T w(f) df 

Jo 


The second moment of E is 


/ 772 - 772 

r/2 dt 1 J_ dt *I 2 (h)P{h) 


(3.9-4) 


77 2 


If, for the time being, we set t 2 equal to ti + r, it is seen from section 3.2 
that we have an expression for the probability density of I(t\) and I(t\ + r) 
and hence we may obtain the required average: 


_ 4 p +0O M +00 


dl 2 111 \ exp 


(j~2^2 (toll + toll 


- 2frill*)') 


(3.9-5) 


A 2 = \f/l — xpl , Ii = I(ti), I 2 = I(t\ + r) = /(^) 
The integral may be evaluated by (3.5-6) when we set 


I\ = 



\p T = —\^0 cos V? 
A = yfro sin <p 


(3.9-6) 


35 “Filtered Thermal Noise—Fluctuation of Energy as a Function of Interval Length , 
Jour. Acous. Soc. Am., 14 (1943), 216-227. 
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Thus 


Till = *o( 1 + 2 cos 2 *) 


= ^ + 2\p; 


(3.9-7) 


Incidentally, this gives an expression for the correlation function of / 2 (/). 
Replacing r by its value of / 2 — t x and returning to (3.9-4), 


& = rVo + 


LZ * L 


772 


dhi\t 2 - h) 


When we introduce o- r , the standard deviation of E , and use 


we obtain 


err = (£ 


2 ~ 2 

Or — E z — 7)1 T 


TI2 - r/2 

rf/l / 

r/2 J-r/2 


(3.9-8) 


where the second line may be obtained from the first either by changing the 

\ariable 3 of integration, as in (3.9-27), or by the method used below in 

dealing with £•’. I am indebted to Prof. Kac for pointing out the advantage 

obtained by reducing the double integral to a single integral. It should be 

noted that the limits of integration - r/2, T/2 in the double integral may 

be replaced by 0, T by making the change of variable t = t' — r/2 for both 
/1 and t 2 . 

When we use 


(2.1-6) 


we obtain the result stated in the paper, namely, 


w(f 2 ) dU 


[~ sin 2 njfi + /„) r 

L **C/i + fi) 2 

, sin 2 *-(/, - /,)r ~1 

*Hfx ~ UY \ 


(3.9-9) 


t/t th '/ , formula is a PP lied to a relatively narrow band-pass filter and if 

fa [ > > 1 the contribution of the/, + /, term may be neglected and 
we have the approximation 


2 

(7 t 


+oo 




df 2 


sin 2 rr(/i — / 2 )r 
^ 2 (/. - / 2 ) 2 


= w? T(J„ - f a ) 


(3.9-10) 


= w 0 m T 
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where, from (3.9-3) 


m T = w 0 T(f b - f a ) (3.9-11) 

The third moment E? may be computed in the same way. However, in 

this case it pays to introduce the characteristic function for the distribution 

of I(t i), I(t 2 ), I(t 3 ). Since this distribution is normal its characteristic 
function is 


Average exp [iz x h + iz 2 1 2 + « 3 / 3 ] 


— ex P ( z i + z\ + Z 3 ) + — h)z lZ 2 


(3.9-12) 


+ 'Kh — h)ziz z + Hh — k)z 2 zz 


From the definition of the characteristic function it follows that 


= — coeff. of 


222 
Z\ Z 2 Z3 • 


2 ! 2 ! 2 ! 


in ch. f. 


“ ^0 4- 2\p 0 0/4 4- ^31 4- ^ 32 ) 


(3.9-13) 


4" 8^21^81^32 

where we have written ^21 for - ^), etc. When (3.9-13) is multiplied 
by dt\ dl 2 dtz , the variables integrated from 0 to Z, and the above double 
integral expression for <j\ used, we find 


f dt\ f dtz f < 

J 0 Jn Jn 


Denoting the triple integral on the right by J and differentiating, 

dj 

, = 3 / dh 

'0 


dT 


f * / 

Jo Jo 

f dx J 

Jo Jo 

f *1 


In going from the first line to the second h and t? were replaced by Z — x and 
Z — y, respectively. In going from the second to the third use was made of 
the relations symbolized by 

T 

dx 

'0 •'o 

T 

dx 

'0 •'o 


f dx f dy = f dx f dy 4- f dx C dy 
Jo Jo Jo Jo Jo J x 


= f dx f dy+ f dy f 

Jo Jo Jo Jo 


dx 
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and of the fact that the integrand is symmetrical in x and y. 
d.J/dT with respect to T from 0 to T\, using the formula 



Integrating 


noting that J is zero when T is zero, and dropping the subscript on Ti finally 
gives 



48 f dx f dy(T — x)\P(x)^(y)\P(x — y). 
Jo jo 


E* may be treated in a similar way. It is found that 


(E E) 3(£ E) — 3!2 I dt\ I dto I dt% / dt\ \p2i 'Pzi ^42 'Paz 

Jo JO JQ Jo 

which may be reduced to the sum of two triple integrals. It is interesting 
to note that the expression on the leit is the fourth semi-invariant of the 
random variable E and gives us a measure of the peaked ness of the dis¬ 
tribution (kurtosis). Likewise, the second and third moments about the 
mean are the second and third semi-invariants of E. This suggests that 

possibly the higher semi-invariants may also be expressed as similar multiple 
integrals. 

So far, in this section, we have been speaking of the statistical constants 
of E. The determination of an exact expression for the probability density 
of E, in which T occurs as a parameter, seems to be quite difficult. 

When T is very small E is approximately l\t)T. The probability that 
E lies in dE is the probability that the current lies in -I, -/ -dl plus the 
probability that the current lies in /, I -f dl\ 

2d I P E 

VWo exp ~ 2^0 = (2,nAo£r) 1/2 ex P - 2 ~^f dE C 3 - 9 ' 1 *) 

where E is positive, 

1 = (f) , dl = I (ET)~ m dE 

and T is assumed to be so small that /(/) does not change appreciably during 
an interval of length T. 6 

\\ hen T is very large we may divide it into a number of intervals say n 
each of length T/n. Let E r be the contribution of the r th interval. The 
energy E for the entire interval is then 

E — Ei 4- Esi 4 - • • • -f E n 

If the sub-intervals are large enough the E r ’s are substantially independent 
random variables. If in addition n is large enough £ is distributed 
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mally, approximately. 

Hence when T is very large the probability that E 

lies in dE is 

dE (E - m T y 

(3.9-15) 


6XP 2a\ 

where 

m T = T J w(f) df 




(3.9-16) 


<x\ = r / w 2 (J) df 

j 0 



the second relation being obtained by letting T —> oo in (3.9-9). The 
analogy with Campbell’s theorem, section 1.2, is evident. When we deal 
with a band pass filter we may use (3.9-10) and (3.9-11). 


Consider a relatively narrow band pass filter such that we may find a T 
for which Tf a > > 2tt but T(fb — f a ) < < .64. Thus several cycles of fre¬ 
quency fa are contained in T but, from (3.8-15), the envelope does not change 
appreciably during this interval. Thus throughout this interval /(/) may 
be considered to be a sine wave of amplitude R. The corresponding value 
of E is approximately 



where the distribution of the envelope R is given by (3.7-10) 
it follows that the probability of E lying in dE is 


From this 


dE E 

^f exp ~ 


_ _ &E e -*lm T 

to T m T 


(3.9-17) 


when E is small but not too small. 

When we look at (3.9-14) and (3.9-17) we observe that they are of the 
form 


a n+1 £” 

r(* + 1) 



(3.9-18) 


Moreover, the normal law (3.9-15), may be obtained from this by letting n 
become large. This suggests that an approximate expression for the dis¬ 
tribution of E is given by (3.9-18) when a and n are selected so as to give 
the values of m T and cr T obtained from (3.9-3) and (3.9-9). This gives 


a = 


m T 

~2 > 
(J T 


ft “f- 1 = 


2 

Trlj* 


(3.9-19) 
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and if we drop the subscript T and substitute the value of a in (3.9-18) we 
get 


m 

r(n + 1) 


exp 



n = -r - 1 (3.9-20) 

( 7 * 


An idea of how this distribution behaves may be obtained from the 
following table: 


n 

T(J b - fa) 

-r j6 

*60 

*75 

*26 

*76 





*.60 

*60 

0 

0 

.29 

.695 

1.39 

.415 

2.00 

1 

1.45 

.96 

1.68 

2.69 

.572 

1.60 

2 

2.4 

1.73 

2.67 

3.94 

.647 

1.47 

3 

3.4 

2.54 

3.67 

5.12 

.692 

1.39 

5 

5.4 

4.22 

5.67 

7.42 

.744 

1.31 

10 

10.5 

8.63 

10.67 

13.02 

.808 

1.22 

24 

25 

21.47 

24.67 

28.17 

.870 

1.14 

48 

50 

44.1 

48.7 

53.5 

.905 

1.10 


where n is the exponent in (3.9-20). The column T(f b — f a ) holds only for a 
narrow band pass filter and was obtained by reading the curve y A in Fig. 1 
of the above mentioned paper. The figures in this column are not very 
accurate. The next three columns give the points which divide the dis¬ 
tribution into four intervals of equal probability: 



= energy exceeded 75% of time 
= energy exceeded 50% of time 
= energy exceeded 25% of time 


The values in these columns were obtained from Pearson’s table of the in¬ 
complete gamma function. The last two columns show how the distribu¬ 
tion clusters around the average value as the normal law is approached. 

For the larger values of « we expected the normal law (3.9-15) to be 
approached. Since, for this law the 25, 50, and 75 per cent points are at 
m — .675o-, m, and m -f .675(7 we have to a first approximation 

*.60 = J = (n + 1) = T(J b - f a ) 

*.26 = ^ (m — .675(7) = £.50 — .675\/*!co (3.9-21) 

*76 = *.60 + - 675-\/*!50 

This agrees with the table. 
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Thiede 36 has studied the mean square value of the fluctuations of the 
integral 

A(t) = f d T (3.9-22) 


The reading of a hot wire ammeter through which a current I is passing is 
proportional to A(t). a is a constant of the meter. Here we study A(t) by 



Fig. 5* Filtered thermal noise—spread of energy fluctuation 


r‘i+r 

E = / J 2 (0 dt, t\ random, I is noise current. 

y\ = E.n/E.to , yi = F.m/F.m . 

fb — fa = band width of filter. 


first obtaining its correlation function. This method of approach enables 
us to extend Thiede’s results 

The distributed portion of the power spectrum of A(t) is given by (3.9- 
30). When the power spectrum w(f) of 1(f) is zero except over the band 
fa < f < fb where it is Wq , the power spectrum of A (t) is 


2wl(J b ~ fa~ f) 


for 0 </</»-/. 


a 2 + 4tt 2 / 2 

and is zero from fb — f a up to 2f a . The spectrum from 2 f a to 2f b is not zero, 
and may be obtained from (3.9-34). The mean square fluctuation of A(t) 
is given, in the general case, by (3.9-28) and (3.9-32). For the band pass 
case, when ( f b — fa) /a is large, 


r.m.s. 


A(t) - A 



36 Elec. Nachr. Tek., 13 (1936), 84-95. This is an excellent article. 

* Note added in proof. The value of yt at 0 should be .415 instead of .403. 
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We start by setting t = t — u which transforms the integral for A(t) into 


A{t) = [ I\t - w)<T au 

Jo 


dn 


(3.9-23) 


In order to obtain the correlation function 'F(t) for A(t) we multiply A (l) 
by A(t t) and average over all the possible currents 

SKr) = A(t)Mi -f r j 

= [ e au du [ e a ' dv ave. I'(t — u)I~(t 4 - t — v) 

Jo Jo 

Just as in (3.9-4) the average in the integrand is the correlation function of 
2 

I (t) } the argument being / + r - v - / + « = r -f u — v. From (3.9-7) 
it is seen that this is 

i/'o + 2^ 2 (r + u — i) 

where \J/(t) is the correlation function of /(/). Hence 

'F(r) = ^ -F 2 f du 
or J o 

Irom the integral (3.9-23) for A(t) it is seen that the average value of 
A(t) is 


L 


QO 


di 


> e 


— an —m 


\p'(r 4~ u — v) (3.9-24) 


where we have used 



(3.9-25) 


ypo = i/40) = f w(f) dj = 1- 

J 0 


Lsing this result again, only this time applying it to A (/), gives 


A 2 (t) = *(0) 


00 


= A* 4- 2 [ du f dv e 

Jo Jo 


—au—av ,2 


<£“(« — v) 


(3.9-26) 


The double integrals may be transformed by means of the change oi 
variable u 4- v = x, u — v = y. Then (3.9-24) becomes 


r 2 


*(t) = A‘ + 


[I iy l 


QO 


dx 4- 


£>/ 


00 


dx e ax ^ 2 (r + y) 


r 2 


a L € a *^ 2 ( r + >) + — y)l 


(3.9-27) 


= A~ 4- * 1 - _a ^r./2 
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\\ hen we make use of the fact that \p(y) is an even function of y we see, from 
(3.9-26), that the mean square fluctuation of A(t) is 

U{t) - A ) 2 = - A 2 = l [ e~ a ^\y) dy (3.9-28) 

oc Jo 

'Hr') may be expressed in terms of integrals involving the power spectrum 
■w{f) of I{t). The work starts with (3.9-24) and is much the same as in 
going from (3.9-8) to (3.9-9). The result is 

T(t) = A 2 + J dfi f <f/ 2 w(/i)w(/ 2 ) 

JQ J 0 



cos 2ir(/i + / 2 )t 


+ 


cos 27 t(/i — 


ifi ~h)r 1 

»(/. - ml 


+ [2t (/i+/*)!* «* + [ 2 

It is convenient to define if(—/) for negative frequencies to be equal to 

■w(f). The integration with respect to / 2 may then be taken from - °o to 
+ co and we get 

'f'(r) = A + f dfi f df 2 w(fi)w(f 2 ) — ° S (3 9-29) 

•'o i-oo 7 KJ1J KJiJ a 2 + [2ir(/i -/ 2 )] 2 1 } 

The power spectrum W(f) of A(l) may be obtained by integrating *(r): 

w '(f) =4 J T(r) cos 2 t t/t * 

Let us concern ourselves with the fluctuating portion A(t) — A of A{t). 
Its power spectrum W c {f) is 


W, 


(/) = 4 J ('F(r) — A *) cos 2irfr dr 


The integration is simplified by using Fourier’s integral formula in the form 

+00 


f dr f df 2 F(f<i) cos 2i t(u — / 2 )r = §/?(**) 

•'O **-00 


We get 


(3.9-30) 


Wc(f) = a 2 + 4jr 2 j2 j ( rf/,[w(A)»(/ + /l) + +/j)] 

= L w{fi)w{f - fi) dfi 

The simplicity of this result suggests that a simpler derivation may be 
found. If we attempt to use the result 


*(/) = Limit 2 -±SLQ_ 


(2.5-3) 


T— oo 
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where S(f) is given by (2.1-2) we find that we need the result 


Limit | f dh f !*&)!*&) 

T —*oo i •'O JQ 


/ +0C 

™(fi)v>(f - /i) df\ 

an 


(3.9-31) 


where / > 0 and 1(1) is a noise current with w(f) as its power spectrum. 
This may be proved by using (3.9-7) and 

8 ^‘( t ) cos 2tt/t dr — J u>(x)w(f — *) 

which is given by equation (4C-6) in Appendix 4C. 

An expression for the mean square fluctuation of A(t) in terms of w(f) may 
be obtained by setting r equal to zero in (3.9-29) 

(A (0 ~ AY = *(0) - A 2 


Jo J - z o a + 47t (/i — / 2 ) 


(3.9-32) 


The same result may be obtained by integrating I V c (f), (3.9-30), from 0 
to x : 


r df r 

Jo a 2 + 4rr 2 / 2 jL„ d f' w (fiXf ~ fi) (3.9-33) 

Although this differs in appearance from (3.9-32) it may be transformed 
into that expression by making use of w(—f) = w{f). 

Suppose that I(t) is the current through an ideal band pass filter so that 
W(f) 1S zero exce P l in the band/ 0 < / < f b where it is . Then, if 3f a >f b , 




A = ^ (fb - /.) 


(3.9-34) 


,+- 2w ’°(f* -/»-/) 0 </</„- /„ 

L W(X)W(/ ~ X) dx = ^«(/ - 2/J 2f a < f < f„ + /a 

l w ®(2/» ~ /) /»+/«</< 2f b 

and is zero outside these ranges. The power spectrum W c (f) .may be ob 

F, e .m”"2sr "" by diVidmE ,h ~ S „■ + 4,y. 

W(/) = 2wl f /b ~ r ° </» -/«■-/) df 

J 0 a 2 -j- 47T 2 / 2 

-f 7 /, J f' b + /a - (/ — 2/ a ) o /* 2/b OA — /) 

* + w d f + w *L,±ArAkdf 


U(t) - A) 2 = 


+ wj 


' 2/6 


: + 4tt 2 / 2 
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If an exact answer is desired the integrations may be performed. When we 

assume that/6 — f a << ft + fa we may obtain approximations for the last 
two integrals. 


(A(t) - A? = wl \ f ± - L a tarT 1 2?r ^- ft 

[_ Ta a 

- J_ hc t + - ft 2 4- (A - /°) 2 1 

4^ a* • a 2 + + / 0 ) 2 J 

Furthermore, if 27r(/t — / a )A* is large we have 

(A(t) - AY « wl 


and the relative r.m.s. fluctuation is 


r.m.s. of 


ruw-i)ir « t /2 

A J 12 (/» - /.) J 


This result may also be obtained from (3.9-10) and (3.9-11) by assuming 
a so small that the integral for A(t) may be broken into a great many in¬ 
tegrals each extending over an interval T. aT is assumed so small that 
e~ au is substantially constant over each interval. 


3.10 Distribution of Noise Plus Sine Wave 


Suppose we have a steady sinusoidal current 

Ip = Ipif) — P cos (o>p/ — ip p ) (3.10-1) 


We pick times i\ , t 2 , • • • at random and note the corresponding values of 
the current. How are these values distributed? Picking the times at ran¬ 
dom in (3.10-1) is the same, statistically, as holding t constant and picking 
the phase angles (p p at random from the range 0 to 27 t. If I p be regarded as 
a random variable defined by the random variable tp p , its characteristic 
function is 


i r 2r 

ave e il b = _L / e UP 008 d * 

2tt Jq 


(3.10-2) 


= Jo(Pz) 


and its probability density is 

— f^° e~ i,!p Jo(Pz) dz = 
2tt a -*, 


jl (P 2 - nr 12 


I Ip I < p 
I /, I > p 


(3.10-3) 


In this case it is simpler to obtain the probability density directly from 
(3.10-1) instead of from the characteristic function. 
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Now suppose that we have a noise current I s plus a sine wave. By com¬ 
bining our representation (2.8-6) for I N with the idea of tp p being random 
mentioned above we are led to the representation 

no = / = l P + /.v 

.If 

= P cos (o > p t - v?p) + J2 Cn cos (a',./ - <?„), (3.10-4) 

Cn = 2w(f n )Sf 

where (p p and , • • • are independent random angles. 

If we note I at the random times /, , / 2 • • • how are the observed values 
distributed? Since /„ and / v may be regarded as independent random 
variables and since the characteristic function for the sum of two such vari¬ 
ables is the product of their characteristic functions we have from (3 1-6) 
and (3.10-2) 


ave. e = ave. e xz{,p+Is) 

= J o( Pz) exp ^—~~) 


(3.10-5) 


which gives the characteristic function of /. The probability density of 7 


l r [ 

\tv J- 




C Jo{Pz) dz = 


^ f e- (1 
a/ 27t^q Jo 


— (/ — P cos 6) 2 / 2 ^q 


dd (3.10-6) 


In the same way the two-dimensional probability density of (/, , /,) 
where 7 1 = I(t) is a sine wave plus noise (3.10-4) and / 2 = I(t + T ) j s ; t s 
value at a constant interval t later, may be shown to be 


W ~ Vr) 
2 7T 


2 \ — 1/2 „2 




(3.10-7) 


where 


3(9) - <Ao[(/i - P cos 0) 2 + (/ 2 - P cos (9 + a>„ t)) 2 ] 

- 2t// r (I 1 - P cos 9)(/ 2 - p cos (0 + UpT )) 
The characteristic function for h and / 2 is 

ave. = /.(P^ + 2«* cos <a p r) 


X exp 


[-i 


(« 2 + 


f 2 ) — 


(3.10-8) 


(JanT^) ^ 
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Sometimes the distribution of the envelope of 

I = P cos pt + I N (3.10-9) 

is of interest. Here we have replaced by p and have set <p p to zero. By 
the envelope we mean R(t) given by 

R\t) = R 2 = (/> + I c ) 2 + I] (3.10-10) 

where I c is the component of I N “in phase” with cos pt and I a is the com¬ 
ponent “in phase” with sin pt: 

Ic = 2Z G„ COS [(&)„ — P)t — <p„] 

I. = X) c n sin [(&>„ — p)t — <p n ] 

Ik = Ic cos pt — I t sin pt 

7k = 7 e = if = to 

Since I c and I s are distributed normally about zero with a variance of 
\po , the probability densities of the variables 

X = P + Ic 

y = is 


are 


(2'ml/o) 1/2 exp — 


(* ~ P) 

2po 


(2irpo) 1/2 exp — 


2Po 


respectively. Setting 


x = R cos 0 


y = i? sin 6 

and using these distributions shows that the probability of a point (#, y) 
lying in the ring R, R -f- dR is 

RdR 
27 n /' 0 


L 


RdR 

po 


exp 



R 2 + P 2 

2po 


RP 

po 



10 - 11 ) 


where /o is the Bessel function with imaginary argument. 

oo 2n 

2 


/•« = e 


n—o 2 2n m ! n ! 
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and is a tabulated function. Thus (3.10-11) gives the probability density 
of the envelope R. 

The average value of R n may be obtained by multiplying (3.10-11) by R n 
and integrating from 0 to . Expansion of the Bessel function and term- 
wise integration gives 

-<2W-r(” + l ) ,F, (-1 ; , ; - Q (3.10-12) 

where jFj is a hypergeometric function. 38 In going from the first line to 
the second we have used Rummer’s first transformation of this function. 
A special case is 

R 2 = 1* + 2^o (3.10-13) 

When only noise is present, P — 0 and 


R = (2*„) ,/2 r(3) = 




(3.10-14) 


Before going further with (3.10-11) it is convenient to make the following 
change of notation 


v 





(3.10-15) 


a is the ratio (sine wave amplitude)/(r.m.s. noise current). 

Instead of the random variable R we now have the random variable v whose 
probability density is 



(3.10-16) 


Curves of p{y) versus v are plotted in Fig. 6 for the values 0, 1, 2, 3, 5 of a 
Curves showing the probability that v is less than a stated amount i e dis- 
tnbution curves for v, are given in Fig. 7. These curves were obtained by 
integrating p(v) numerically. The following useful expression for this 
probability has been given by W. R. Bennett in some unpublished work. 


I 


+ a‘ 


] s CD uav) (3 - i °' 17 ) 


" Ciinra of this function are given in “Tables of Functions”, Tahnkc and Emde (19^ 
p. 275, and some of its properties are stated in Appendix 4C. ’ 
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This is obtained by integration by parts using 

J u n 7 n -i(au) du = u n I n (au)/a 

Wlien av > > 1 but 1 < < a — v, Bennett has shown that (3.10-17) 
leads to 



Fig. 6—Probability density of envelope R of I(t ) = P cos pt -f I N 


This formula may also be obtained by putting the asymptotic expansion 
(3.10-19) for p(v) in (3.10-17), integrating by parts twice, and neglecting 
higher order terms. 

When av becomes large we may replace I 0 (av) by its asymptotic expres¬ 
sion. The expression for p(v) is then 

M ~ 0 + iL) G ia) exp [- (JL T^-] (3 - 10 - 19) 

Thus when either a becomes large or v is far out on the tail of the probability 
density curve, the distribution behaves like a normal law. In terms of the 
original quantities, the normal law has an average of P and a standard devia¬ 
tion of \J/1 12 . This standard deviation is the same as the standard deviation 
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of the instantaneous values of Is- When av » 1 and a » | v — a | we may 
expand the coefficient of the exponential term in (3.10-19) in powers of 


59-991 


0 Otb — 


O.OiL 

-4 






i - 1 -- 


-i 



R M S I 


v — a 


Fig. 7—Distribution function of envelope R of 1(1) = P cos pi -f- I N 

(v — a)/a. Integrating this expansion termwise gives, when terms of magni 
tude less than a~ 3 are neglected, 







When I consists of two sine waves plus noise 

/ = P cos pt + Q sin qt + I N , (3.10-20) 

where the radian frequencies p and q are incommensurable, the probability 
density of the envelope R is 

Rj a rJo(Rr)J 0 (Pr)MQr)e-*° r ’ 12 dr (3.10-21) 

where \p 0 is 11 . When Q is zero the integral may be evaluated to give 
(3.10-11). When both P and Q are zero the probability density for R 
when only noise is present is obtained. If there are three sine waves instead 
of two then another Bessel function must be placed in the integrand, and 
so on. To define R it is convenient to think of the noise as being confined 
to a relatively narrow band and the frequencies of the sine waves lying 
within, or close to, this band. As in equations (3.7-2) to (3.7-4), we refer 
all terms to a representative mid-band frequency f m = « m /2 tt by using 
equations of the type 

cos pt = cos [(p - co m )t + u> m t] 

— cos (p — (j) m )t cos (j) m t — sin (p — oj m )t sin 
In this way we obtain 

V = A cos u m t — B sin c o m t = R cos (oj m t + 6) (3.10-22) 

where A and B are relatively slowly varying functions of t given by 
A = P cos {p — w m )t + Q cos ( q — a o m )t 

< C n COS (a) n t a ) m t <Pn) 

(3.10-23) 

B = P sin (p — a ) m )t + Q sin (q — co m )t 

, . + S c n sin (u) n t — 03 m t — <p n ) 


and 


R 2 = A 2 + B 2 , 

tan 0 = B/A 


R > 0 


(3.10-24) 


As might be expected, (3.10-21) is closely associated with the problem 
of random flights and may be obtained from Kluyver’s result 39 by assuming 

39 G. N. Watson, “Theory of Bessel Functions” (Cambridge, 1922), p. 420. 

110 


243 


the noise to correspond to a very large number of very small random dis¬ 
placements. 

Another way of deriving (3.10-21) is to assume (p — u> m )/, (q — aij/, 
V 'i , v '2 , • ■ • are independent random angles. The characteristic function 
of A , B is 


ave. e 


iuA+ivB 


= MPVu 2 + v-)Jo(QVu- + 


The probability density of A, B is 




-foe 


+ *> 


dii 


dv e 


— iuA — ivB ^ iuA-HvD 

ave. e 


When the change of variables 


A = R cos 6 u — r cos 


B — R sin 6 


v = r sin 


is made the integration with respect to may be performed. The double 
integral becomes 


- [ rMPr)J 0 (Qr)Jo(Rr)e-‘*° mr2 dr 

# 7T JO 


This leads directly to (3.10-21) when we observe that dAdB = RdRdO. 
Incidentally, if 

I = 0(1 + k cos pt) cos qt -f Is 

in which p < < q, similar considerations show that the probability density 
of R is 


f da f rJ 0 (Rr)Jo[Qr(l + k cos a)]e~ ( * o/2)r2 dr 

Jo Jo 


r_ r 2x 
2tt Jo 


when u> m is taken to be q. The integration with respect to r may be per¬ 
formed. This relation is closely connected with (3.10-11). 

Returning now to the case in which I is the sum of two sine waves plus 
noise, we may show from (3.10-21) and 


n+1 


n+1 


Jo(Rr) dR = 


Oil) 

i-t) 
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that the average value of R n is, when — 2 < re (n) < — L 


2 n+1 r 


Rn = 


('ll)/ 

n\ Jo 


QO 


—n—1 


MPr)Jo{Qr)e~ H,tn 


r (-i) 

/ n \ - « (-?) (-*)*(-y)* (3.10-25) 

-OW-rfe + i)g £ V - 


= Wo) 


n,2 r (- + 1 ) £ ^ (y 

\2 ^ / j£S A!*! 


*) 


A 




It appears very probable that this result could be extended, by analytic 
continuation, to positive integer values of n. We have used the notation 


(a)o = 1, (a)fc = a (a +1) • • • (a + k — 1) 


x = 


P^_ 

2*o’ 




(3.10-26) 


2*o 


and have denoted the Legendre polynomial by Pk(z). The series converge 
for all values of P, Q, and * 0 and terminate when n is an even positive integer. 

When x or y, or both, are large in comparison with unity we may use the 
integral for R n to obtain the asymptotic expansion, assuming Q < P so 
that y < x, 





i(* - 




(3.10-27) 


When n is an even positive integer this series terminates and gives the same 
expression as (3.10-25). When n is an odd integer the 2 p\ may be expressed 
in terms of the complete elliptic functions E and K of modulus y 1/2 x“ 1/2 : 



The higher terms may be computed from 


(3.10-28) 


a(l - z) 2 iFi(a + 1, a + 1; l;z) = (2 a - 1)(1 + z) 2 F 1 (a 1 a;l;z) 

+ (1 - a) 2 Fi(a - 1, a - 1; l;s) (3.10-29) 
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which is a special case of 

ab(y 4 1)(1 — z) 2 2 Fi(a 4 1, b 4 1; c\ z) = A 2 F 1 (a, b\ c\z) 

— (y — l)(c — a)(c — b) 2 Fi(a — 1 } b — 1; c; z) (3.10-30) 
where y = c — a — b and 

A = (y 2 — 1)7 -f (1 — z)[(y — 1 )(c — b)(b - 1 ) 4 (7 + 1 )a(c — a — 1 )] 

Although this expression does not show it, A is really symmetrical in a 
and b. A symmetrical form may be obtained by using the expression ob¬ 
tained by putting s = 0 in (3.10-30). 


3.11 Shot Effect Representation 

In most of the work in this part the representations (2.8-1) or (2.8-6) 
have been used as a starting point. Here we point out that the shot effect 
representation used in Part I may also be used as a starting point. 

I*or example, suppose we wish to find the two dimensional distribution of 
lit) and lit -|- r) discussed in Section 3.2. This is a special case of the distri¬ 
bution of the two variables 


where we now assume 






4* 00 

E G(t - h) 


A :——00 


(3.11-1) 


/ + 00 * -f 00 

F(t) dl = I G{t)dt= 0 (3.11-2) 

00 J— 00 

in order that the average values of / and J may be zero. In fact, to get 
lit -\- t) from J(t) we set G[t) equal to F{t 4 r). 

The distribution of I and J may be obtained in much the same manner 

as was the distribution of I alone in section 1.4. The characteristic func¬ 
tion of the distribution is 


/(w, v) = ave. e 


iul+ivj 


= exp v 


/ 4oo 

[«■ 

00 


uFU)-rivG(t) 


- 1 )dt 


(3.11-3) 


where v is the expected number of events (electron arrivals in the shot effect) 
per second. The probability density of / and J is 


47T 2 


!>/ 


+0C 


dv € 


— iul—ivj 


00 


/(«.») 


(3.11-4) 
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The semi-invariants X m , n are given by the generating function 

log /(«, ®) = E ~ (iu) m (iv) n + o[(i«)*, («)*] 


m,n=1 Witt! 


and are 


r +ac 

Xm.n = * / F m (t)G n (t) dt 

J—oo 


(3.11-5) 


As y —> co the distribution of / and / approaches a two dimensional normal 
law. The approximation to this normal law may be obtained in much the 
same manner as in section 1.6. From our assumption (3.11-2) it follows 
that Xio and Xoi are zero. From the relation between the second moments 
and semi-invariants X we have 


Mil 


= X 20 + \!o = V f F\l) dt 

00 


Ml2 


— Xu + X 10 X 01 = v £ 


+00 


00 


F(t)G{t) dt 


(3.11-6) 


M 22 


/ +« 

G 2 (t) dt 

00 


where the notation in the subscripts of the /it’s differs from that of the X’s, 
the change being made to bring it in line with sections 2.9 and 2.10 so that 
we may write down the normal distribution at once. 

The formulas (3.11-6) are closely related to Rowland’s generalization of 
Campbell’s theorem mentioned just below equation (1.5-9). 
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PART IV 


NOISE THROUGH NON-LINEAR DEVICES 


4.0 Introduction 


We shall consider two problems which concern noise passing through 
detectors or other non-linear devices. The first deals with the statistical 
properties of the output of a non-linear device, that is, with its average 
value, its fluctuation about this average and so on. The second problem 
may be stated more definitely: Given a non-linear device and an input 
consisting of noise alone, or of noise plus a signal. What is the power 
spectrum of the output? 

There does not seem to be much published material on the first problem. 
However, from conversation with other people, I have learned that it has 
been studied independently by several investigators. The same is probably 
true of the second problem although here the published material is somewhat 
more plentiful. This makes it difficult to assign credit where credit is due. 
Much of the material given here had its origin in discussions with friends, 
especially with W. R. Bennett, J. H. Van Week, and David Middleton. 
Help was obtained from the recent paper 3 ' by Bennett, and also from the 
manuscript of a forthcoming paper by Middleton. 40 

4.1 Low Frequency Output of a Square Law Device 
Let the output current I of the device be related to the input voltage V by 

/ = otV 2 (4.1-1) 

where a is a constant. When the power spectrum of V is confined to a 
relatively narrow band, the power spectrum of / consists of two portions. 
One portion clusters around twice the mid-band frequency of V and the 
other around zero frequency. We are interested in the low frequency 
portion. The current corresponding to this portion will be denoted by 
IU , and is the current which would flow if a low pass filter were inserted 
in the output to remove the upper portion of the spectrum. It is convenient 
to divide 1 1 ( into two components: 


I it — Idc ■+■ Ilf 


(4.1-2) 


37 Loc. cit. (Section 3.10). 


40 Cruft Laboratory and the Research Laboratory of Physics, Harvard University 
Cambridge, Mass. In the following sections references to Bennett’s paper and Middle- 
ton s manuscript are made by simply giving the authors’ names. 



<248 


where the subscripts stand for “total low” frequency, “direct current,” 
and “low frequency,” respectively. We have 

Idc = average I a = 1a (4.1-3) 

Mean Square It/ = average (la — I dc ) 2 = l]i — I dc 

Probably the simplest method of obtaining I dc is to square the given ex¬ 
pression for V and pick out the terms independent of time. Thus if 

V = P cos pt + Q cos qt + V N (4.1-4) 

we have 

Iic = “ (t +1 + r£) (4.i-5) 


I ft may also be obtained by picking out the low frequency terms. How¬ 
ever, here we wish to use the square law device, and the linear rectifier in the 
next section, to illustrate a general method of dealing with the statistical 
properties of the output of a non-linear device when the input voltage is 
restricted to a relatively narrow band. 

If none of the low frequency spectrum is removed by filters, 

Iu = «j ( 4 . 1 - 6 ) 

where R is the envelope of V. The probability density and the statistical 
properties of I a may be derived from this relation when the distribution 
function of R is known. 41 Before discussing these properties we shall 
establish (4.1-6). 

Equation (4.1-6) is a special case of a more general result established 
in Section 4.3. However, its truth may be seen by taking the example 

V — P cos pt -f- Q cos qt -f- V N (4.1-4) 


where/ p = p/2 tt and f q = q/2 tt lie within, or close to, the band of the noise 
voltage V N . 

By using formulas of the type 


cos pt = cos [(p — c o m )t + c c m t] 

= cos (p — a ) m )t cos (o m t — sin (p — c o m )t sin co m t 


(4.1-7) 


41 When part of the low-frequency spectrum is removed, the problem becomes much 
more difficult. I de may be obtained as above, but to get /Jy it is necessary to first deter¬ 
mine the power spectrum of I (Section 4.5) and then integrate over the appropriate por¬ 
tion of it. Concerning the distribution of iTf , our present knowledge tells us only that it 
lies between the one given by (4.1-6) and the normal law which it approaches when only 
a narrow portion of the low frequency spectrum is passed by the audio frequency filter 
(Section 4.3). 
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we may refer all terms to the mid-band frequency f m = o> m /27r, as is done 
in equations (3.7-2) to (3.7-4). 

In this wav we obtain 

V = A cos o) m t — B sin c c m t = R cos (c c m t + 0), (4.1-8) 

where A and B are relatively slowly varying functions of t given by 
A = P cos (p — a } m )t + Q cos (q — a> m )/ + 22 C n COS (a ) n t — u m t ~ Y?n), 

n 

5 = P sin (p — w m )t + Q sin (q — t o m )l ~h ^2 c n sin (u n t — o) m t — <p n ) 


and 


R 2 = A 2 + 5 2 , R > 0 
tan 6 = ^/.4. 


(4.1-9) 


This definition of I? has also been given in equations (3.10-22, 23, 24). 
The envelope of V is R and the output current is 



<xR' 



~ cos (2 Umt + 2d) 


(4.1-10) 


Since R is a slowly varying function of time, so is R 2 . The power spectrum 
of R 2 is confined to frequencies much lower than 2f m and consequently the 
power spectrum of R~ cos (2aW -|- 26) is clustered around 2/ m . Thus the 
only term in / contributing to the low frequency output is aR 2 /2 which is 
what we wished to show. 

We now return to the statistical properties of I t l . First, consider the 
case in which V consists of noise only, V = V# , so that the probability 
density of the envelope R is 


where 


Hence 


-K 2 /2* 0 


■Ao = [rms V „} 2 = V% 




' f « - ' 5 - 

2.2 
= a Yo 


(3.7-10) 

(4.1-11) 


(4.1-12) 
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Second, consider the case in which 


V = V N + P cos pt (4.1-13) 

where p/2-w lies near the noise band of V N . The probability density of the 
envelope R is 



From this and equations (3.10-12), (3.10-13), we find 



= cep o -f- 



(3.10-11) 


(4.1-14) 



(4.1-15) 


In (4.1-14) p 0 is the mean square value of V N and P*/2 is the mean 
square value of the signal. These two equations show that Ide and the 
rms value of Iy are independent of the distribution of the noise power 
spectrum in V N as long as the input V is confined to a relatively narrow band. 
In other words, although this distribution does affect the power spectrum 
of the output, it does not affect the d.c. and rms Iy when po and P are given. 
That the same is also true for a large class of non-linear devices was first 
pointed out by Middleton (see end of Section 4.9). 

When the voltage is 42 


V — V N + P cos pt + Q cos qt , (4.1-4) 

P ^ Qy we obtain from equation (3.10-25) 

“(* + ?+?) 

fit = f R A (4.1-16) 


Iy — ot 2 [rf + P 2 po + Q 2 po + 

42 These results are special cases, obtained by assuming no audio frequency filter, of 
formulas given by F. C. Williams, Jour. Inst, of E. E. y 80 (1937), 218-226. Williams also 
discusses the response of a linear rectifier to (4.1-4) when P Q Vn • An account 
of Williams’ work is given by E. B. Moullin, “Spontaneous Fluctuations of Voltage,” 
Oxford (1938), Chap. 7. 
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4.2 Low Frequency Output of a Linear Rectifier 


In the case of the linear rectifier 



V < 0 

V > 0 


(4.2-1) 


the low frequency output current, assuming no audio frequency filter, is 



(4.2-2) 


This formula, like its analogue (4.1-6) for the square law device, assumes 
that the applied signal and noise lie within a relatively narrow band. It 
may be used to compute the probability density and statistical properties 
of / 1 ( when the corresponding information regarding the envelope R of the 
applied voltage is known. 


'Hie truth of (4.2-2) may be seen by considering the output 1 . It con¬ 
sists of the positive halves of the oscillations of a\\ The envelope of 1 is 
the same as that of ad '. However, the area under the loops of / is only about 
1 /t r of the area under aR, this being the ratio of the area under a loop of 
sin .r to the area of a rectangle of unit height and length 2 tt. From the 
low frequency point of view these loops of 7 merge into a current which 
varies as aR/ tt. 

When V is a sine wave plus noise, 


V = Vn “F P cos pt 


the average value of / 1 ( is 


43 


-) 

2*o / 


~; K "“(s) 

where 7o , 7i are Bessel functions of imaginary argument and 



x = 


P 2 _ ave. sine wave power 


2*o 


ave. noise power 


(4.1-13) 


(4.2-3) 


(4.2-4) 


43 This result was discovered independently by several investigators imnna 

==r & isssa rar&js as issSSS? 

Linear Devices”, Paper read before I.R.E., Jan. 28, 1944. y eertain * Non 
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t/'o being the average value oi V 2 N . Equation (4.2-3) follows from the 
formulas (3.10-12) and (4B-9). When x is large the asymptotic expansion 
(4B-3) of the iFi gives 

, -~;[ p + S + sl + -] <4 - 2 - 5) 

Similarly, the mean square value of I t f is 

^ = = + 2 ^>) (4.M) 

7i 7T 


and the mean square value of the low frequency current Ilf , excluding the 
d.c., is given by 

7-2 „ 7-2 

Ilf = Id — /dc 


When x is large we have 



and when x = 0, 


(4.2-7) 


(4.2-8) 


Curves for Idc are given in Figures 1, 2 and 3 of Bennett’s paper. He 

also gives curves, in Fig. 4, showing l\f versus x. These show that the 
effect of the higher order modulation terms is small when Iij is computed 
by adding low frequency modulation products. 

When V consists of two sine waves plus noise, 

V = V N + P cos pt -f- Q cos qtj (4.1-4) 


the average value of Iu is, from (3.10-25), a sort of double iF\ function: 

M 1/2 f' v <-*>*- 

^ k\k\m\tni 

(4.2-9) 


Ia c 




27 r) JtTo m=o klklmlml 


(-*)*(->) 


=* - Mm 


where 


x = 




Q 


P k (z) = Legendre polynomial (4.2-10) 


If x is large and y < x, we have from (3.10-27) the asymptotic expression 


Idc 


“ P E (k-hk-h 1;?) (4.2-11) 

7T ^ £!** \ V 
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The 2 Fi may be expressed in terms of the complete elliptic functions E and 
K of modulus y ll2 x~ 1 ' 2 . Thus 


2-Fl 





iF i 





(3.10-28) 


and the higher terms may be computed from the recurrence relation 
(3.10-29). The first term, k = 0, in (4.2-11) gives I dc when the noise is 
absent. 44 

The mean square value of Iu is 

ft = i R2 = i ^ + p2 + e 2 J (4.2-u) 


From this expression and our expression for 1 dc , the rms value of the low 
frequency current, If f , excluding the d.c., may be computed. For example, 
when the noise is small, 

Ff ~ $ [p 1 + C 2 - (p 2 Fi ( -1, - \; 1; 

/ / v ... (4.2-15) 

+ 2\po (i - 2 o(-|, 

I he term independent of \po gives the mean square low frequency current 
in the absence of noise. As Q goes to zero (4.2-15) approaches the leading 
term in (4.2-7), as it should. W hen P = Q our formula breaks down and 
it appears that we need the asymptotic behavior of 45 



( —4)*(2«! 
[*!] 4 



In view of the questionable nature of the derivation given in Section 3.10 
of equations (4.2-9) and (4.2-11) it was thought that a numerical check on 
their equivalence would be worth while. Accordingly, the values x = 4 
y = 3 were used in the second series of (4.2-9). It was found that the 
largest term (about 130) in the summation occurred at k = 11 . In all 24 
terms were taken. The result obtained was 


R 


V2*o 


= 2.5502 


“See W. R. Bennett B.S.T.J., Vol. 12 (1933), 228-243. 

Ihis may he done by the method given bv VV B Ford r* i 

Umv. of Mich. Press (1936), Chap. VI. y d> Asym P totlc Developments, 
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For the same values of .r and y the asymptotic series (4.2-11) gave 

2.40 + 0.171 + .075 + 0.52 + .... 

If we stop just before the smallest term we get 2.57 for the sum. If we 
include the smallest term we get 2.65. This agreement indicates that 
(4.2-11) is actually the asymptotic expansion of (4.2-9). 

When the voltage is of the form 

V = (9(1 + k cos pt) cos qt + V N 


we may use 



iFi 



1 ; — y( 1 -f k cos 0) 




(4.2-16) 


where R is the envelope with respect to the frequency q/2ir and y is given 
by (4.2-10). The integral may be evaluated by writing i/ 7 ! as a power 
series and integrating termwise using the result 


— / (1 + k cos OY cos mO dO 

!7T Jn 


(-0 


m 


2 m m ! 




m — l m — l \ 


\m + 1 



(4.2-17) 


where tn is a non-negative integer, l any number, 

(a) m = a(a + 1) * * • (« + m - 1), («)o = 1, and (0)o = 1. 

The integral may also be evaluated in terms of the associated Legendre 
function. 

By applying the methods of Section 3.10 to (4.2-16) we are led to 


R 2 


-*( 


1 + 



-b 2\po 





(4.2-18) 


where the asymptotic series holds when y is very large and k is not too close 
to unity. These expressions give 

iff ~ (Q 2 f + *o[2 - (1 - k 2 )~ m \ + -' ) 
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The reader might be tempted to associate the coefficient of in (4.2-19) 
with the continuous portion of the output power spectrum. However, this 
would not be correct. It appears that the principal contribution of the 

continuous portion of the power spectrum to l} f is afyo/V 2 , just as in (4.2-7) 
when k is zero. The difference between this and the corresponding term 
in (4.2--19) seems to arise from the fact that the amplitude of the recovered 
signal is not exactly cxQk,'ir but is modified by the presence of the noise. 
This general type of behavior might be expected on physical grounds since 

changing P , say doubling it, in (4.2-7) does not appreciably affect the l} f 
in (4.2-7) (which is due entirely to the continuous portion of the noise 
spectrum). The modulating wave may be regarded as slowly making 
changes of this sort in P. 

4.3 Some Statistical Properties of the Output of a General 

Non-Linear Device 

Our general problem is this: Given a non-linear device whose output I is 
related to its input V by the relation 

/ = f F(iu)e iVu du (4A-1) 

Li r J c 

which is discussed in Appendix 4A. Let the input V contain noise in addi¬ 
tion to the signal. Choose some frequency band in the output for study. 
What are the statistical properties of the current flowing in this band? 

It seems to be difficult to handle this general problem. However, it 
appears that the two following results are true. 

1. As the output band is chosen narrower and narrower the statistical 
properties of the corresponding current approach those of the random noise 
current discussed in Part III (provided no signal harmonic lies within the 
band). In particular, the instantaneous current values are distributed 
normally. 

2. When the input V is confined to a relatively narrow band the power 
spectrum of the output I is clustered around the 0 th (d.c.), 1 st, 2 nd, etc. 
harmonics of the midband frequency of V. The low frequency output in¬ 
cluding the d.c. is 

Id = zt 0 (i?) = — J c F(iu)J 0 (uR) du (4.3-11) 

where R is the envelope of V. 

The envelope of the nth harmonic of the output, when n > 0, is 

A n(R) = ^ / c F(iu)J n (uR) du (4.3-1) 
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The mathematical statement is 




A n (R) cos (nco m t + nd) 


(4.3-9) 


where f m = w m /(27r) is the representative mid-band frequency of V and 0 
is a relatively slowly varying phase angle. The results of Sections 4.1 
and 4.2 are special cases of this. 

Middleton’s result that the noise power in each of the output bands (in 

the entire band corresponding to a given harmonic) depends only on V 2 N = 
ipo and not on the spectrum of V N , where V N is the noise voltage component 
of V, may also be obtained from (4.3-9). We note that the total power 
in the w th band depends only on the mean square value of its envelope 
i4„(/£), and that the probability density of the envelope R of the input in¬ 
volves V N only through xpo . 

The argument we shall use in discussing the first result is not very satis¬ 
factory. It runs as follows. The output current / may be divided into two 
parts. One consists of sinusoidal terms due to the signal. The other con¬ 
sists of noise. We shall be concerned only with the latter which we shall 
call I N . The correlation between two values of I N separated by an interval 
of time approaches zero as the interval becomes large. Let r be an interval 
long enough to ensure that the two values of I N are substantially 
independent. Choose an interval of time T long enough to contain many 
intervals of length r. Expand I N as a Fourier series over this interval. 
We have 





27 mt . , 

cos + o n sin 





e-'2-i/f’/ Ar( / ) dt 


Let the band chosen for study be/o — 


^ to/o + ^ and let 



(4.3-2) 


(4.3-3) 


where ni and n 2 are integers. The number of components in the band is 
(« 2 — «i)- We suppose 0 is such that this is small in comparison with T/r. 
The output of the band is 

Jn = iz cos 1 bn sm 2 ~Y~\ (4.3-4) 
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where 


a 


ib n = If 

7 Jo 


+ »2 . «1 + «2 I 'T x ! r 

« —--— + w — -2— — foT ~r (n — /o T) 

We choose the hand so narrow that 

fi 2 — J/i « r/r or i3r « 1 


(4.3-5) 


(4.3-6) 


This enables us to write approximately 


n 


a n — ib n = X 


— «o 


t2ir((n r»-/ 0 )rr 


r=*l 


r 


[ e~' 2rfot /.v( 

“'(r-l)r 


(/) dt 


r 1 = r/r, r being chosen to make ri an integer. Suppose we do this for 
a large number of intervals of length 7\ Then 7. v (/) will differ from interval 
to interval. The set of integrals for r = 1 gives us an array of values which 
we regard as defining the distribution of a complex random variable, say 
.ri . Similarly the set of integrals for r = 2 defines the distribution of a 
second random variable .v 2 , and so on to .r r , . Because we have chosen r 
so large that /*(/) in any one integral is practically independent of its values 
in the other integrals we may say that Xi , .v 2 , • • • x ri are independent. 

We have 



r i 


- ibn, = r 


g * 2 »((nj/D—/ 0 )fr ^ 


r-l 


flni+i ib ny +\ 


fln 2 — 

and if n 2 - Wl « n , as was assumed in (4.3-6), we may apply the central 
limit theorem to show that a ni , b ni , a„ 1+1 , • • • a „ 2 , b n2 tend to become in¬ 
dependent and normally distributed about zero as we let the band width 
^ 0 and T-> oo (and hence n —► oc) in such a way as to keep n 2 - n x 

fixed. In this work we make use of the fact that /„(/) is such that the real 
and imaginary parts of *i, ar 2 , • • • *r all have the same average and standard 
deviation. It is convenient to assume f 0 T is an integer. 

Thus as the band width 0 approaches zero the band output 7 V given by 
(4.3-4) may be represented in the same way, namely as (2.8-1), as was the 
random no.se current studied in Part III. Hence J K tends to have the 


r\ _ 

r-l 


—. 22 g *2r((n j/ T)—f 0 )rr ^ 

r-l 
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same properties as the random noise current studied there. For example, 
the distribution of / A - tends towards a normal law. In our discussion we 
had to assume that /3r « 1. If the voltage V applied to the non-linear 
device is confined to a relatively narrow frequency band, say ft — fa , it 
appears that the interval r (chosen above so that /(/) and I(t + r) are sub¬ 
stantially independent) may be taken to be of the order of l/(/& — /<,). 
In this case J N tends to behave like a random noise current if /?/(/& ""/a) is 
much smaller than unity. 

We now turn our attention to the second statement made at the begin¬ 
ning of this section. Let the applied voltage be confined to a relatively 
narrow band so that it may be represented by equation (4.1-8) of Section 
4.1, 

V = R cos ( Wm / + 0), R > 0, (4.1-8) 

where f m = co m /(27r) is some representative frequency within the band 
and R and 6 are functions of time which vary slowly in comparison with 
cos u) m t. We call R the envelope of V. 

From equation (4A-1) 

/ = 2- f F(iu)e iuR cos du (4.3-7) 

Z7T J c 

We expand the integrand by means of 

e ix 008 * = £ €„ *" cos n<pj„(x) (4.3-8) 

n«=0 

where € 0 is 1 and e n is 2 when n > 0 and J n (x) is a Bessel function. 
Thus 

00 

/ = 22 A n (R) COS (nu) m t + nd) (4.3-9) 

n=0 

where 

A n {R) = e„ P [ F(iu)J n (uR) du (4.3-10) 

Z7T J C 

Since I? is a relatively slowly varying function of time we expect the 
same to be true of ^4 „(!?), at least for moderately small values of n. Thus 
from (4.3-9) we see that the power spectrum of I will consist of a suc¬ 
cession of bands, the n th band being clustered around the frequency nf m . 

If we eliminate all of the bands except the « th by means of a filter we 
see that the output will have the envelope A n (R) when n ^ 1. Taking 
n to be zero, shows that the low frequency output is simply 

=L f F(iu)Jo(uR) du (4.3-11) 

Z7T J c 
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Taking n to be one shows that the band iround f m given by 

V (4.3-12) 

R 

The statistical properties of the low frequency output and of the en¬ 
velopes of the output bands may be obtained from those of R. For ex¬ 
ample, the probability density of is of the form 

P(R) / (4.3-13) 


where p(R) is the probability density of R. In this expression R is con¬ 
sidered as a function of .-!« . 

It should be noted that we have been assuming that all of the band 
surrounding the harmonic frequency nf m is taken. W hen we take only a 
portion of it, presumably the statistical properties will tend to approach 
those of a random noise current in accordance with the first statement made 
at the beginning of this section. 

When we apply (4.3-11) to the square law device we have 


F(iu) 


2a 

M 3 


A 0 (R) = 


_2 a f 

2 7TJ J 


( 0 +) 


Jo(uR) 


u 




When we apply (4.3-11) to the linear rectifier: 


F(iu) 



A 0 (R) 



where the path of integration passes under the origin. These two results 
agree with those obtained in Section 4.1 and 4.2 from simple considerations. 
As a final example we find the low frequency output of a biased linear 
rectifier in terms of the envelope R of the applied voltage. From the table 
of F(iu) given in Appendix 4A we see that F(iu) corresponding to 

/ = 0, V < B 

I = V — B y V > B 
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is 


F{iu) = - 


iuB 


U 


Consequently, the low frequency output i 


MR) = ~~ e-' uB J a ( u R)u~ 2 du 


IS 


where the path of integration is indented downwards at the origin. When 
> R the value of the integral is zero since then the path of integration 
may be closed in the lower half plane by an infinite semi-circle This value 
also follows at once from the physics of the problem. When -R < B < R 
we may integrate by parts and get 


0 


i r +0 ° _• 

= 2 n e + RJi{uK)]u~ l du 

B 1 f°° 

= ~ J + Wo [jB Sin uBJ ^ uR ) + R cos uBJ^uR)\u~ x du 

- B B ,- 

-9 + - arc sin - + - y/B? - B 2 

Z 7T A 7T 


(4.3-14) 


2 ~ 7r \ 2’ 2 ’ 2 ’ R 2 J ’ R<B< 


R 


This hypergeometric function turns up again in equation (4.7-6) 
in the range —R < B < R , 


Also 


dAc 

dR 




B* 
R 2 


When ^ is negative and R < i?, the path of integration may be closed 

by an infinite semicircle in the upper half plane and the value of the integral 
is proportional to the residue of the pole at the origin: 


A 0 (R) 


- 2 ” (~h) <-'« 


= -B 


Thus, to summarize, the low frequency output for our linear rectifier is, 
for B > 0, (R is always positive) 


Ao(R) = 0, 


R < B 


a t t>\ B . B . B 1 /—- 

A 0 (R) = — - + - arc sin - + - \/R 2 — B 2 , B < R 

2 7r R 7r 


(4.3-15) 
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and for B <0 it is 


Ao(R) = | B |, R < | B | 

Ao(R) = + ^ + — arc sin + - Vi? 2 - B 2 , 

2 7T A 7T 




(4.3-16) 


where the arc sines lie between 0 and tt/2 . yl 0 (2?) and its first derivative 

with respect to R are continuous. 

hrom (4.3-15), the d.c. output current is, for B > 0, 

I <“ = f e [~f + f arc sin | + 1 V> 2 - £ 2 J P(R) dR (4.3-15) 

where p(R) is the probability density of the envelope of the input V, e.g., 

p(R) is of the form (3.7—10) for noise alone, and of the form (3.10-11) for 

Similarly, the rms value of the low frequency 
current /u , excluding d.c., may be computed from 



where, if B > 0, 



/"[-§+- 

J B |_ Z 7T 


B , 1 /-T 2 

arc sin - + - V R 2 - B 2 p(R) dR 


7T 


(4.3-16) 


If \ consists of a sine wave of amplitude P plus noise V N , so it may be 
represented as (4.1-13), and if P » rms V„ , the distribution of R is 
approximately normal. If, in addition, P — B » rms V x > 0, (4.3-15), 
(4.3-16), and (3.10-19) lead to the approximations 


Uc - 




v _L B . B t 1 /— 

" 9 + - arc sin - + - V-P 2 

Z 7T Pit 

i P _i_ -^ 2 + to 

2 ~ TT ' 2ttP 

P 2 - B 2 , 

tPP 2 


- P 2 + 


<Po 


2ir\/pi - B* 


(4.3-17) 


The second expression for I Ac assumes P » B. When B = 0 these re 

terms of (4 ' 2 - 5 ) and (4.2-7). By using a different 
method Middleton has obtained a more precise form of this result. 

Incidentally, for a given applied voltage, 7 dc ( + ) for a positive bias I B I 
is related to 7d c ( —) for a negative bias — | B | by 

7dc( —) = | B | -f- /do(-f) (4.3-18) 

Also r.m.s. /„(+) is equal to r.m.s. /„(-). Equation (4.3-18) follows 
rom a p vsical argument based on the areas underneath a curve of I for 
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the two cases. Both of the above relations follow from formulas given by 
Middleton when 1 is the sum of a sine wave plus noise. They may also be 
derived from (4.3-15) and (4.3-16). 

4.4 Output Power Spectrum 

I he remainder of Part IV will be concerned with methods of solving the 
following problem: Given a non-linear device and an input voltage con¬ 
sisting of noise alone or of a signal plus noise. What is the power spectrum 
of the output? 

In some ways the answer to this problem gives us less information than 
the methods discussed in the first three sections. For example, beyond 
giving the rms value, it tells us very little about the probability density of 
the current corresponding to a given frequency band of the output. On 
the other hand, this rms value may be found (by integrating the power 
spectrum) for any band we choose to study. The methods described earlier 
depended on the input being confined to a relatively narrow band and gave 
information regarding only the entire band corresponding to a given har¬ 
monic (Oth, 1st, 2nd, etc.) of the input. There was no way to study the 
output when part of a band was eliminated by filters except by obtaining 
the power spectrum of some function of the envelope. 

At present there appear to be two general methods available for the 
determination of the output power spectrum each with its own advantages 
and disadvantages. First there is the direct method which has been used 
by W. R. Bennett*, F. C. Williams**, J. R. Ragazzini 46 and others. The 
noise is represented as the sum of a finite number of sinusoidal components. 
The typical modulation product is computed and the output power spectrum 
is obtained by considering the density and amplitude of these products. 
The chief advantage of this method lies in its close relation to the known 
theory of modulation in non-linear circuits. Generally, the lower order 
modulation products are the only ones which contribute significantly to the 
output power and when they are known, the problem is well along towards 
solution. The main disadvantage is the labor of counting the modulation 
products falling in a given interval. However, Bennett has developed a 
method for doing this. 47 

The fundamental idea of the second method is to obtain the correlation 
function for the output current. From this the output power spectrum may 
be obtained by Fourier’s transform. The correlation function method and 
its variations are of more recent origin than the direct method. They have 

* Cited in Section 4.0. Also much of this writer’s work on interference in broad band 
communication systems may be carried over to noise theory without any change in the 
methods used. 

** Cited in Section 4.1. 

« Proc. I.R.E. Vol. 30, pp. 277-288 (June 1942), “The Effect of Fluctuation Voltages 
on the Linear Detector.” 

47 Vol. 19 (1940), pp. 587-610, Appendix B. 
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been discovered independently and at about the same time, by several 

workers. In a paper read before the I.R.E., Jan. 28, 1944, D. O. North 

described results obtained by using the correlation function. J. H. Van 

Vleck and D. Middleton have been using the two variations of the method 

which we shall describe in Sections 4.7 and 4.8, since early in 1943. A 

primitive form of the method of Section 4.8 had been used by A. D. Fowler 

and the writer in some unpublished material written in 1942. Recently, 

I have learned that a method similar to the one used by Fowler and myself 

* •« 

had already been used by Kurt Franz in 1941. 

The correlation function method avoids the problem of counting the 
modulation products. However, in some cases it becomes rather unwieldy. 
Probably it is best to have both methods in mind when investigating anv 
particular problem. The direct method will be illustrated by applying it 
to the square law detector. Two approaches to the correlation function 
method will then be described and applied to examples. 

4.5 Noise Through Square Law-Device 

Probably the most direct method of obtaining the power spectrum W(f) 
of /, where 

/ = or 2 , (4.1 -d 

V being a noise voltage, is to square the expression 

M 

V “ V N = ]£ C m COS (a; ) m t - *> m ) (2.8-6) 

• 

* n which c m is 2w(f m )Af ,, u> m = 2nf m , f m = mAf and <^i , <^2 , • • • <Pm are random 
phase angles. 

Considerable simplification of the algebra results when we replace the 
representation (2.8-6) by 

V„ = \±c m e*”‘-‘- ( 4 . 5 - 1 ) 

Z —00 

Here we have added a term c 0 /2 so as to not have any gaps in the summation 
and have introduced the definitions 


C —m C 


m 


*p — m ^Pm 

a = 2ttA / 


( 4 . 5 - 2 ) 


„ VI E ie P b ^ rtr agung von Rauschspannung uber den linearen Gleichrichter,” Hochfr 
<n r E i l * ktr ? a *y st .-> J une 1941. Other articles by Franz are (I am indebted to Dr. North 
Jannl ° B references) “Beitrage zur Berechnung des Verhaltnisses von Signal 
19 loi 9 Rai ;f£j? sp a nnu n g am Ausgang von Empfangern”, E.N.T., 17, 215, 1940 and 

T ; yy 5 ’ . Dle Amphtuden von Gerauschspannungen”, E.N.T., 19 166 1942 

e May 1944 (p 237), issue of the Wireless Engineer contains an abstract of “The In- 
uence of Carrier Waves on the Noise on the Far Side of Amplitude-Limiters and Linear 
Rectifiers” by Franz and Vellat, E.N.T., Vol. 20, pp. 183-189 (Aug. 1943). 
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Squaring (4.5-1) gives the double series 


4 +00 +00 

Vl = ‘ e < (m +")» 


—00 


+ 0 O +oo 


= ] Z E 

A:——oo n——oo 

Suppose we wish to consider the component of V„ of frequency f k 
It is seen to be 


= kAf. 


J +00 

Ak cos (a )kt — \p K ) = - 23 Ck-nC n 


2 „rr 


00 


cos (kat - <p k _ n - Vn ) (4.5-3) 


The power spectrum W(f) of I at frequency/* is a 2 times the coefficient of 

At in the mean square value of (4.5-3) where the average is taken over the 
<p’s. Thus 

W(f k )Af 4EE c k . n c n c k ^c m 


4 —00 —00 


X ave. cos ( kat — <p k _ n — <p n ) cos ( kat — tp k _^ — ^ m ) 

where the summations extend over m and n. Let n be fixed and consider 
those values of m which give an average different from zero. We see that 
m = n and m = k — n are two such values. The only other possibilities 
are m = —n and m = — & + w, but these lead to terms containing (except 
when n or k equal zero) three different angles, <p n , <p k _ n , and which 
average to zero. Using the fact that the average of cosine squared is one- 
half and that for a given n there are two such terms, we get 


W (fk)Af = 2 cL n c 2 n 

4 n—oo 


+ 00 


(4.4-5) 


= a Af 2^ w(f k - f n )lv(f„)Af 

n—oo 


where in the last step we have used 

fk-n = (k — n)Af = fk — /„ 

and have implied, from c_„ = c n , that 

^(/-„) = w(—nAf) = w{—f n ) 

is equal to w(f n ). 

Thus, from (4.5-4), we get for the power spectrum of I 

W(f ) = a w(x)w(f — x ) dx 


(4.5-5) 


00 
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with the understanding that / is not zero and 

w( — x) = w(x). , (4.5-6) 

The result which is obtained by using (2.8-6), involving the cosines and 
only positive values of ra, is 

W(f) = a [ w(x)w(f — x) dx + 2a 2 [ w(x)w(f + .r) dx (4.5-7) 

Jo Jo 

This contains only positive values, of frequency. (4.5-5) and (4.5-7) are 
equivalent and may readily be transformed into each other. 

The first integral in (4.5-7) arises from second order modulation products 
of the sum type and the second integral from products of the difference 
type. This may be seen by writing the current as 

00 00 

I = W 2 = a 2 C mC n COS (u ) m t — <f m ) COS {(x) n t — tpn) 

1 n— 1 

oo oo 

^ ^ ^ C m C n { COS [ ((dm <rm ] (4.5“~8) 

- m—1 n —1 


+ COS [(a> m + c O n )t + <p m + ip n \\ 

The power in the range f k J k + A/is the power due to modulation products 
of the difference type, u k +l — c o( , plus the power due to the modulation 
products of the sum type, 4~ . In the first type l runs from 1 to cc 

and in the second type l runs from 1 to k — 1 . 

Consider the difference type first, and for the moment take both k and l 
to be fixed. The two sets m = k + f, n = /’and m = l, n = k + l are the 
only values of m and n in (4.5-8) leading to u k+ ( — co{ . The two corre¬ 
sponding terms in (4.5-8) are equal because cos ( — .t) is equal to cos x. The 
average power contributed by these two terms is 

(? **+*<*) X (Average of (2 cos [(o> fc+ ^ - a >t)t - <?*+/ 4- <^]) 2 } 

X 7 (4.5-9) 

= Hacked) 2 

The power contributed to f k ,f k -\-Af by the difference modulation products 
is obtained by summing i from 1 to cc : 

OL 00 00 

y = 2a 2 w ( fk+t )w (//) ( A/ ) 2 

2oi * A / jf w (fk 4- f)w(f) df 

This leads to the second term in (4.5-7). 
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Now consider the modulation products of the sum type. The terms of 
this type in (4.5-8) which give rise to the frequency <a k are those for which 
m + 71 ^ equal to k. Let n be 1 then m = k - 1. The phase of this term 
is random with respect to all the other terms except the one given by n = 

k — 1, m = 1 which has the same phase. The average power contributed 
by these two terms in (4.5-8) is, as in (4.5-9), 

h(aciCk-i) 2 

This disposes of two terms for which m + n is equal to k. Taking n to be 2 
and going through the same process gives two more. Thus, assuming for 
the moment that k is an odd number, the power contributed to the interval 
fk , fk + A/ by the sum modulation products is 

1 i *-i c f k 

9 £ («*» Ck-n) 2 = T 53 (ac n C*_ n ) 2 aAf [ W(J)w(J k - /) df 
z n=l *±71 = 1 Jq 

and this leads to the second term in (4.5-7). 

\\ hen the voltage 1 applied to the square law device is the sum of a noise 
voltage V N and a sine wave: 


V = P cos pt + V N , 

we have 

V 2 = P 2 cos 2 pi + 2 PV N cos pt + vl 
From the two equations 

2 1 1 
cos pt = - -f- - cos 2 pt 

ave. Vs = 2 \ -* f w(J) df 

i £ Jo 

we see that /, or aV 2 , has a dc component of 

a jf+ a j a v>{f)df 

which agrees with (4.1-14), and a sinusoidal component 


— cos 2 pt 


(4.1-13) 

(4.5-10) 


(4.5-11) 


(4.5-12) 


The continuous power spectrum W e (f) of the remaining portion of I may 
be computed from 


2 PV N cos pt+Vl. 
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Using the representation (2.8-6) we see 

M 

2PVs- cos pt = P c m [cos (a ) m t + pt — <p m ) + cos (w m / — pt — v? m )] 

For the moment, we take p = lirrlf. The terms pertaining to frequency 
= >/A/ are those for which 

O-'m T- P ~ 2 irf n \ < j) m — p \ = 27r/ n 

w -f- r = n \ m — r \ — n 

m — n — r m = r db n 

where only positive values of m are to be taken: If n > r, then m is n — r 

or r + n. If n < r, then m is r — n or r -f n. In either case the values 

of m are | n — r | and n + r. The terms of frequency/„ in 2PV N cos pt 
are therefore 


Pc\ n -r\ COS (2?r f n t — (fi\n-r\) + P Cn + r COS (2ir/ n / — <f n+r ) 

and the mean square value of this expression, the average being taken over 
the v?’s, is 

P 2 

— (C|n_ r | + C n + r ) = P 2 Af[w(f\ n _ r \) -f- w(f n+r )] 


= P*Af[w(\f n - Sv I) + w(/« + /,)] 

where / p denotes />/2 tt. 

By combining this with the expression (4.5-5) which arises from V\ 
we see that the continuous portion W c (f) of the power spectrum of I is 

W c {f) = a 2 P*[w(J - f p ) + W {f + /,)] 



w(x)w(f — x) dx 


(4.5-13) 


where w(—f) has the same value as w(f). 

Equation (4.5-13) has been used to compute W c (f) as shown in Fig. 8. 

e input noise is assumed to be uniform over a band of width 0 centered at 

f P , cf. Filter c, Appendix C. By noting the area under the low frequency 
portion of the spectrum we find 


j£ Wc{f) df = a 0w o (P 2 -f- @w 0 ) 

Since the mean square value of the input V N is 4> a = 0w 0 , it is seen that 
this equation agrees with the expression (4.1-15) for the mean square value 
ot It, , the low frequency current, excluding the d.c. If audio frequency 
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filters cut out part of the spectrum, W e (f) may be integrated over the re¬ 
maining portion to give the mean square value of the corresponding output 
current. This idea is mentioned in the footnote pertaining to equation 
(4.1-6). 

If V consists of V N plus two sinusoidal voltages of incommensurable fre¬ 
quencies, say 

V = P cos pt + Q cos qt + Vn » 


CONTINUOUS PORTION OF OUTPUT SPECTRUM OF SQUARE LAW DEVICE 



the continuous portion W e (f) of the power spectrum of I may be shown to be 
(4.5-13) plus the additional terms 

a 2 Q 2 [w(f - /«) + *>(/ + /.)] (4-5-14) 

where f q denotes q/2ir. 

When the voltage applied to the square law device (4.1-1) is 49 
V(t) = Q(1 + k cos pt) cos qt + Vn 

= Q cos qt + ^ cos (p + q)l + cos {p — q)t + V N 

the resulting current contains the dc component 

| C 2 (l + f) +«jf w{f) df (4.5-16) 

49 A complete discussion of this problem is given by L. A. MacColl in a manuscript 
being prepared for publication. 
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The sinusoidal terms of I are obtained by squaring 

<2(1 + k cos pt) cos qt 

and multiplying by a. The remaining portion of I has a continuous power 
spectrum given by 

w.U) = «Q 2 [«»(/ - /,) + »(/ + /.) 

+ ~ »(/ - J, - /,) + f »(/ + /„ 

+ f W(/ - /, + /,) + f »(/ + /, 

/ +» 

w(x)w(f — x) dx 

oo 

where f p denotes />/27r and f q denotes q/2 tt. 

4.6 Two Correlation Function Methods 

As mentioned in Section 4.4 these methods for determining the output 
power spectrum are based on finding the correlation function 'F(r) for the 
output current. From this the power spectrum, W(f), of the output cur¬ 
rent may be obtained from (2.1-5), rewritten as 

W(J) =4 f 4>(r) cos 2ttJt dr (4.6-1) 

Jo 

It will be recalled that W(f)Af may be regarded as the average power which 
would be dissipated by those components of / in the band/,/ + A/if I were 
to flow through a resistance of one ohm. 

The input of the non-linear device is taken to be a voltage F(/). It may, 
for example, consist of a noise voltage V N (t) plus sinusoidal components. 
The output is taken to be a current /(/). The non-linear device is specified 
by a relation between V (/) and /(/). In this work I(t) at time t is assumed 
to be completely determined by the value of V(t) at time t. 

Two methods of obtaining ^(r) will be described. 

(a) Integrating the two-dimensional probability density of V(t) and 
^(* *+" T ) ov er the values allowed by the non-linear device. This 
method, which is especially direct when applied to noise alone through 
rectifiers, was discovered independently by Van Vleck and North, 
(b) Introducing and using the characteristic function, which for the sake 
of brevity will be abbreviated to ch. f., of the two-dimensional prob¬ 
ability distribution of V{t) and V{i + r). 


+ fq) 


-/.)] 


(4.5-17) 
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4.7 Linear Detection of Noise—The Van Vleck-Norte Me:eod 

The method due to \ an Meek and North will be illustrated by using it 
to determine the output power spectrum of a linear detector when the input 
consists of noise alone. 

The linear detector is specified by 



V(t) < 0 
V(t) > 0, 


(4.7-1) 


which may be obtained from (4.2-1) by setting a equal to one, and the input 
voltage is 

V(t) = V N {t) (4.7-2) 


where V N (t) is a noise voltage whose correlation function is ^(r) and whose 
power spectrum is w(f). 

The correlation function 'F(r) is the average value of + r). This 

is the same as the average value of the function 


F(V 1 , V 2 ) 


where we have set 


( ViV* , when both V \, V 2 > 0 

\0, all other F’s, 


Vi = V(t) 

V 2 = V(t + r) 


(4.7-3) 


The two-dimensional distribution of Vi and V 2 is given by (3.2-4), and 
from this it follows that the average value of any function F(Vi, Fj) is 




F(V i, F 2 ) 

2rr | M | 1/2 



(lAo Vl + i o Vl - 2\p, V\ F 2 ) 



(4.7-4) 


where 

| M | = . 


For the linear rectifier case, where F(V l9 V 2 ) is given by (4.7-3), the 
integral is 

dVij f dV % Fi F 2 exp (^° V\ + +> Vl - 2+ r Vl V 2 )] 

, i. ( w - ,:r + *. cos -'[=£•]) 
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where we have used (3.5-4) to evaluate the integral. The arc cosine is 
taken to be between 0 and 7r. We therefore have for the correlation func¬ 
tion of l(t ), 



(4.7-5) 


The power spectrum W(f) may be obtained from this by use of (4.6-1). 
For this purpose it is convenient to write (4.7-5) in terms of a hypergeo¬ 
metric function. By expanding and comparing terms it is seen that 



tl + 'tl 

4 2tt 


o 

I “ 

+ r~ —b terms involving , \p b T , etc. 
4tt^ 0 


(4.7-6) 


• 2 

As will be discussed more fully in Section 4.8, a constant term A~ in ^(r) 
indicates a direct current component of /(/) of .1 amperes. Thus I(t) has 
a dc component equal to 



1 

X rms value of V(t) 

V 2 7T 


(4.7-7) 


This agrees with (4.2-3) when the P of that equation is set equal to zero. 
Integrals of the form 


G n (f) = f \pr cos 2tt/t dr 

Jo 


which result when (4.7-6) is put in (4.6-1) and integrated termwise are 
discussed in Appendix 4C. From the results given there it is seen that if 
we neglect \f/ A T and higher powers we obtain an approximation for the con¬ 
tinuous portion W e (f) of -W(f): 


W c (f) - 


G i(n + G ~ 

TTyo 


_ w(f) , 1 


+ 


47T^o 


\L 


+00 


(4.7-8) 


w(x)w(J — x) dx 


where w(—f) is defined as w(f). 

When V N (t) is uniform over a relatively narrow band extending from 
fa to ft so that w(f) is equal to wo in this band and is zero outside it, we may 
use the results for Filter c of Appendix 4C. The / 0 and 0 given there are 
related to f a and /& by 

f _ f 

J° - 2 ’ 
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fb = /o + \ 


t 

2*2 72 


and the value of w 0 taken there is the same as here and is to/P- The value 
of Gztf) given there leads to the approximation, for low frequencies: 



(4.7-9) 


when 0 < / </&—/«, and to lV 0 (f) = 0 for/*, — f a < f < f a . By setting 
P equal to zero in the curve given in Fig. 8 for W c (f) corresponding to the 
square law detector, we see that the low frequency portion of the power 
spectrum is triangular in shape and is zero at / = 0. Thus, looking at 
(4.7-9), we see that to a first approximation the shape of the output power 
spectrum is the same for a linear detector as for a square law detector when 
the input consists of a relatively narrow band of noise. 

An approximate rms value of the low frequency output current may be 
obtained by integrating (4.7-9) 

— pfb / a 

Iff = / W.(f)df 

Jo 


_ Wo(f b — fa) _ to 

8tt 87r 

rms low freq. current = -/-=■ X rms applied voltage (4.7-10) 

V 07T 


It is seen that this is half of the direct current. It must be kept in mind 
that (4.7-10) is an approximation because we have neglected ti and higher 
powers. The true value may be obtained from (4.2-8). It is seen that the 
coefficient (87t) -1/2 = 0.200 should be replaced by 

; ( 2 ~ tj" - °- 209 

W e (f) for other types of band pass filters may be obtained by using the 
corresponding G } s given in appendix 4C. It turns out that (4.7-10) holds 
for all three types of filters. This is a special case of Middleton’s theorem, 
mentioned several times before, that the total power in any modulation 
product (it will be shown later in Section 4.9 that the term tr in (4.7-6) 
corresponds to the n ih order modulation products) depends only on the 
total input power of the applied noise, not on its spectral distribution. 

4.8 The Characteristic Function Method 

As mentioned in the preceding parts, especially in connection with equa¬ 
tion (1.4-3), the ch. f. of a random .variable x is the average value of exp 
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(tux). This is a function of u. The ch. f. of two random variables x and 
y is the average value of exp (iux -f ivy ) and is a function of u and v. The 
ch. f. which we shall use here is the ch. f. of the two random variables V(l) 
and V(t -|- r) where L(/) is the voltage applied to the non-linear device, and 
the randomness is introduced by t being selected at random, r remaining 
fixed. We mav write this characteristic function as 

t r T 

g(u, r, r) = Limit- / exp [iuV(t) -f ivV(t -f r)] dt (4.8-1) 

r-»» 1 Jo 


If V(t) contains a noise voltage r. v (/), as it always does in this section, and 
if we use the representation (2.8-1) or (2.8-6) a large number of random 
parameters (a n ’s and b n } s or <^ n ’s) will appear in (4.8-1). In accordance 
with our use of such representations we may average over these parameters 
without changing the value of (4.8-1) and may thereby simplify the integra¬ 
tion. 

For example suppose 

V(t) = V.(t) + V N (t) (4.8-2) 


where V a (t) is some regular voltage which may, e.g., consist of one or more 
sine waves. Substituting this in (4.8-1) and using the result (3.2-7) that 
the ch. f. of V N (t) and V N (t + t) is 


£. v (w, i', r) = ave. exp [iuV s (t) -f ivV s (t + r)l 


T to 

= e xp|_- y 


(« 2 + 


V 2 ) ~ trUV J 


(4.8-3) 


\p T = \f/(r) being the correlation function of 1 >(0» we obtain for the ch. f. 
of V(t) and V(t + r), 


g(w, v, t) = exp |^—y (« 2 + v) — \p r uv^ 


rp 

X Limit i f exp [iuV,(t) -f ivV,{t + r)] 

r—oo 1 Jo 


dt 


(4.8-4) 


= v, r)g,(u , i>, r) 

In the last line we have used g,(u , v, r) to denote the limit in the line above: 

1 f r 

g.{u, v, T ) = Limit - / exp [iuV,{t) + ivV+ r)] dt (4.8-5) 

r—oo 1 Jo 

The principal reason we use the ch. f. is because quite a few non-linear 
devices may be described by the integral 

I = 2- J F{iu)e iVn du (4A-1) 
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where the function F(iu) and the path of integration C are chosen to fit the 

device. Examples of such devices are given in Appendix 4A. The corre¬ 
lation function 4'(r) of I(t) is given by 

T 

'l'(r) = Limit 1 f I(t)I{t + t) dt 

r—oo 1 Jo 

T 

- L ,™‘ sU I. d, L du l * 

= 4~s J c f<iu > du f c F( ™'l d,! (4.8-6) 

1 r T 

Limit - / exp [iuV(t) + ivV(t + r)] dt 

T-* oo l JO 

= 4tt 2 fc du i c v > r ) dv 

This is the fundamental formula of the ch. f. method. 

When \ (/) is the sum of a noise voltage and a regular voltage, as in 
(4.8-2), (4.8-6) becomes 


= 47 * / du f F(«)<r ( *° /2 > 


* * rUV v , r) dv 


(4.8-7) 


where &(«, r, r) is the ch. f. of F s (/) and F.(* + T ) given by (4.8-5). This 
is a definite expression for 4>(r). All that follows is devoted to the evalua¬ 
tion of this integral and to the evaluation of 


W(J) = 4 J 4'(r) cos 2 tt fr dr 


(4.6-1) 


for the power spectrum of /. 

Quite often /(/) will contain dc and periodic components. It seems con¬ 
venient to deal with these separately since they correspond to terms in 
4 f (r) which cause the integral (4.6-1) for W(J) to diverge. In fact, from 
Section 2.2 it follows that a correlation function of the form 

C 2 

A 2 + — cos 2nf 0 r (2.2-3) 

corresponds to a current 


A C cos (27 t/o* — <p) 


( 2 . 2 - 2 ) 


* 
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where the phase angle <p cannot be determined from (2.2-3) since it does not 
affect the average power. 

Consider the correlation function for !'(/) = V ,(/) + Vn(1) given by 

(4.8-2). It is 

Limit 1 [" f V.(t)V,(t + t) dt + [ V.(t)V„(t + r) dt 

7’—*oo 1 L^O * / 0 

r T r T 1 (4 ' S_8} 

+ J o VAt) V.{t + r)dt + Vs{t)VAt + T) dt I 

Since 1,(0 and l', v (/) are unrelated the contributions of the second and 
third integrals vanish leaving us with the result 


Correlation function of Y(t) — Correlation function of !'.,(/) 

Correlation function of 1 \v(t). 


(4.8-9) 


Now as r —> cc the correlation function of V N (t) becomes zero while that of 
Y 9 (0 becomes of the type (2.2-3) given above. Hence the correlation func¬ 
tion of the regular voltage T a (/) may be obtained from V(t) by letting r —> oo 
and [)icking out the non-vanishing terms. Although we have been speaking 
of V(t), the same results hold for lit) and this process may be used to pick 
out those parts of 'k(r) which correspond to the dc and periodic components 
of /(/). Thus, if we look at (4.8-7) we see that as r —> « , —> 0, while the 
gs ( m , v, t) corresponding to T s (/) given by (4.8-5) remains unchanged in 
general magnitude. This last statement may be hard to see, but examina¬ 
tion of the cases discussed later show that it is true, at least for these cases. 
Thus the portion of T(r) corresponding to the dc and periodic components 
of I{t) is, setting \p T = 0 in (4.8-7), 

= T £ F(i«)e _< * o/2> “ 2 du f c F(tv)e- ( *° mv 'g.(u, v, r) dv (4.8-10) 

where the subscript cc indicates that ^(r) is that part of ^(r) which does 
not vanish as r-> cc . 

We may write (4.8-9), when applied to /(/), as 

*(r) = 'Mr) + * e (r) (4.8-11) 

where ^ e (r) is the correlation function of the “continuous” portion of the 
power spectrum of I{t). 

Incidentally, the separation of ^(r) into the two parts shown in (4.8-11) 
may be avoided if one is willing to use the 6(f) functions in order to interpret 
the integral in (4.6-1) as explained in Section 2.2. This method gives the 
proper dc and sinusoidal components even though (4.6-1) does not con¬ 
verge (because of the presence of the terms leading to ^«(r)). 
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4.9 Noise Plus Sine Wave Applied to Non-Linear Device 

In order to illustrate the characteristic function method described in 
Section 4.8 we shall consider the case of a non-linear device specified by 

7 = i /e F(iu)e<y “ du (4A-1) 

when V consists of a noise voltage plus a sine wave: 

V(t) = P cos pt 4- V N (t) (4.1-13) 

As usual, V N (t) has the power spectrum w(f) and the correlation function 
\Ht). <A(r) is often written as i£ r for the sake of shortness. Comparing 

(4.1-13) with (4.8-2) gives 


V t (t) = P cos pt 


(4.9-1) 


Our first task is to compute the ch. f. g s (u, v, r) for the pair of random 
variables V 3 (t) and V s (l -f r). We do this by using the integral (4.8-5): 


r—oo 


l 


— Jo(PVu 2 + v 2 + 2uv cos pr) 


(4.9-2) 


where Jo is a Bessel function. The integration is performed by writing 
u cos pt + v cos p {t -f- r) = (u 4 - v cos pr) cos pt — v sin pr sin pt 

= y/ii 2 4- v 2 4- 2 uv cos pr cos (pt 4~ phase angle) 


and using the integral 


«■> -:hi 


2 r 


it cos t i. 

e at 


The correlation function for (4.1-13) has also been given ih Section 3.10. 

The correlation function 'k(r) for I(t) may now be obtained by substi¬ 
tuting the above expressions in (4.8-7) 

*(r) = A f du F(iu)e ~ {umu2 [ dv F(iv)e- ( *° ,2)v2 

4?r Jc Jc (4.9-3) 

e *T*'j 0 (Py/ « 2 4 - v 2 4 - 2uv cos pr). 

^(r), the correlation function for the d.c. and periodic components of /, 
may, according to (4.8-10), be obtained from this by setting \p T equal to zero. 

When we have a particular non-linear device in mind the appropriate 
F(iu) may often be obtained from Appendix 4^4. For example, F(iu) for a 
linear rectifier is —u~ 2 . Inserting this value in (4.9-3) gives a definite 
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double integral for 'I'(t). If there were some easy way to evaluate this in¬ 
tegral then everything would be fine. Unfortunately, no simple method of 
evaluation has yet been found. However, one method is available which is 
closely related to the direct method used by Bennett. It is based on the 
expansion 

g,(u, v , r) = Jo(P\/u 2 + v 2 4- 2 uv cos pr) 

00 

= 22 €„(— ) n J n (Pu)J n (Pv) cos npT (4.9-4) 

n — 0 


«o=l, e n = 2 for n > 1 


This expansion enables us to write the troublesome terms in (4.9-3) as 
e irUV Jo(P\/u 2 + v 2 + 2 uv cos pr) 

(4.9-5) 

J n (Pu)J n (Pv) 

n-0 *-0 £! 


CO CO 


= 52 ( — ) n+ *€„ COS npT 


(\pr uv) k 


The virtue of this double sum is that it simplifies the integration. Thus, 
putting it in (4.9-3) and setting 

hnk = U J F{iu)u“du (4.9-6) 

gives 

oo co ^ 

'HO = 52 52 TC fr^nkCn COS «/>T (4.9~7) 

n-0 *-0 &! 

The correlation function 4' ao (r) for the dc and periodic components of I 
are obtained by letting r —> where \p T —► 0. Only the terms for which 
k = 0 remain: 

00 

^=o(r) = 22 €„ h 2 n0 cos npr (4.9-8) 

n«0 

Comparing this with the known fact that the correlation function of 


A + C cos (2tt/o/ - <p) (2.2-2) 

is 

C 2 

A * + y cos 2 tt/ 0 t (2.2-3) 


and remembering that e 0 is one while e n is two for n > 1 shows that 

Amplitude of dc component of I = hoo 

Amplitude of ^ component of / = 2 h n0 


(4.9-9) 


145 


► V 



Incidentally, these expressions for the amplitudes follow almost at once from 

the direct method of solution. This will be shown in connection with equa¬ 
tion (4.9-17). 

Since the correlation function 4' c (r) for the continuous portion W e (f) of 
the power spectrum for I is given by 



*c(t) = *(t) - 

(4.8-11) 

we also have 

00 00 ^ 

^c(r) = ^ 23 T-j ^rh 2 nk € n COS UpT 

n~0 k~l R\ 

(4.9-10) 

When this is 

substituted in 



w c (f) = 4 J <ff e {r) cos 2tt/t dr 

(4.9-11) 

we obtain 



w c (f) = 

S £ t? «* [* (/ - 2) + »(/ + 2)] 

(4.9-12) 

where 

G k (/) = f \pr cos 27r/r dr 

Jo 

(4.9-13) 


is the function studied in Appendix 4 C. G k (f) is an even function of/. The 
double series (4.9-12) for W c looks rather formidable. However, when we 
are interested in a particular portion of the frequency spectrum often only 
a few terms of the series are needed. 

It has been mentioned above that the direct method of obtaining the out¬ 
put power spectrum is closely related to the equations just derived. We 
now study this relation. 

We start with the following result from modulation theory 50 : Let the 
voltage 


V = Po cos .To 4- Pi cos Xi 4- • • • + P* cos X N 
Xk = pkt, k = 0 , 1 , • • • N y 


(4.9-14) 


where the p k s are incommensurable, be applied to the device (4A-1). The 
output current is 



oo 


£ 

m 0 =0 


oo 

£ 

m lV -0 


\a 


m 0 * • •ms c mo 


(4.9-15) 


• * * c mx cos m 0 xo cos miXi • • • cos m N x N 

50 Bennett and Rice, “Note on Methods of Computing Modulation Products,” Phil. 
Mag. S.7, V. 18, pp. 422-424, Sept. 1934, and Bennett’s paper cited in Section 4.0. 
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where to = 1 and e m = 2 for tn > 1. When the product of the cosines is 
expressed as a sum of cosines of the angles mo xo ± fn\X\ • • • ±m N x N , it is 
seen that the coefficient of the typical term is A mQ ... mN , except when all 
the m’s are zero in which case it is £*4o...o . Thus 

oo-• o = dc component of / 

I A m o-.-m.v I = amplitude of component of frequency (4.9-16) 

x— | Wopo dtz mi pi db • • • ± rrixpH | 

7T 


For all values of the m’s, 

i Kf f N 

A mQ... m \ / F(iu) j[ J fn^Pfli) dll 

7T J c r-0 

M = w 0 + Wi + • • • -f- m N 


(4.9-17) 


Following Bennett’s procedure, we identify V as given by (4.9-14), with 


V = P cos pt -f V N (4.1-13) 

by setting P 0 = P, p 0 = p , and representing the noise voltage V N by the sum 
of the remaining terms. Since this makes Pi , P s all very small, Laplace's 
process indicates that in (4.9-17) we may put 


.V 


n Jo{P r u) = exp 


r-1 


U‘ 

"4 


(Pi + * ‘ + Pa) 


__ € ~^ou 2 /2 


(4.9-18) 


We have used the fact that \f/ 0 is the mean square value of V N . It follows 
from these equations that 

dc component of I = ~ f F(fw)/o(P«y~* o/2)uJ du 

Ztt J c • 

Component of frequency^ = - f F{iu)J n (Pu)e~* 0U ' 12 du 

Ztt tv j c 

These results are identical with those of (4.9-9). 

The equations just derived show that h n0 is to be associated with the n th 
harmonic of p. In much the same way it may be shown that h nk is to be 
associated with the modulation products arising from the n th harmonic of 
p and k of the elementary sinusoidal components representing V N . We 
consider only combinations of the form pi ± p 2 =t p z , taking k = 3 for ex¬ 
ample, and neglect terms of the form 3pi and 2 p x ± p 2 . The former type 
is much more numerous, there being about N 3 of them while there are only 
about N and .V 2 , respectively, of the latter type. 
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We again take k = 3 and consider m x , m 2 , m 3 to be one, and m, , ... 
to be zero, corresponding to the modulation product np ± p x ± p 2 ± p 
By making the same sort of approximations as Bennett does we find 

P P P c 

A 1,1,1,o,o...o = —-—g-— 3 J F(iu)J n (Pu)u 3 du 


_ A Pi Ps , 

- a - "n3 


W'hen any other modulation product of the form np ± p ri ± p rt ± p r) is 

considered we get a similar expression in which P X PJ>\ is replaced "by 

Pr,Pr 2 Pr 3 . This may be done for any value of k. The result indicates 

that h nk , and consequently also the («, k) th terms in the double series 

(4.9-10) and (4.9-12) for 'i'c(r) and W e (f), are to be associated with the 

modulation products of order (», k), the n referring to the signal and the k 
to the noise components. 

We now may state a theorem due to Middleton regarding the total power 

in the modulation products of a given order. For a given non-linear device 

(i.e. F{iu) is given), the total power which would be dissipated by all of the 

modulation products which are of order («, k) if / were to flow through a 
resistance of one ohm is 


*n*(0) 



€nlVifkU 

ki 


(4.9-19) 


The important feature of this expression is that it depends only on the r.m.s. 

value of Vff and on F(iu). It depends not at all upon the spectral dis¬ 
tribution of the noise power in the input. 

The proof of (4.9-19) is based on the relation 


* n *(0) = [ Wnk(f) df 

JO 

between the total power dissipated by all the (n, k) order products and the 
corresponding correlation function obtained from (4.9-7). 

This theorem has been used by Middleton to show that when the input 
is confined to a relatively narrow frequency band, so that the output spec¬ 
trum consists of bands, the power in each band depends only on V 2 W and not 
on the spectrum of V N . 


4.10 Miscellaneous Results Obtained by Correlation Function 

Method 

In this section a number of results which may be obtained from the theory 
given in the sections following 4.6 are given. 
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When the input to the square law device 


/ = aV 


(4.1-1) 


consists of noise only, so that V = V N , the correlation function for I is 


^(r) = a[\po -f 2 \pi] 


(4.10-1) 


where i p r is the correlation function of V N . This may be compared with 
equation (3.9-7). When T is general, 

T(r) = ave. I(t)I{t + r) 

2 rr2 


= ave. a V {t)V (t + r) 


2 v n a- . . , ( iu)‘ (iv) . 

a X Coemcient oi ——- in power series expansion 


(4.10-2) 


of ch. f. of V{t), V{t + r) 


where we have used a known property of the characteristic function. An 
expression for the ch. f., denoted by g(u, v, r), is given by (4.8-4). For 
example, when V consists of a sine wave plus noise, (4.1-13), the ch. f. is 
obtainable from (4.9-3). Hence, 


2 2 

U V 


'F(r) = Coeff. of — in expansion of 


a Jo(Py/u 2 + H- 2 uv cos />r) 


X exp 


- K? 


[-!•<” 


+ ^ 2 ) 


— \l/ r uv\ 


(4.10-3) 


+ *po 


P A 


+ ~ cos 2 pT + 2P 2 \pr cos pr -f- 2\p 

o 



The first two terms give the dc and second harmonic. The last two terms 
may be used to compute W c (f) as given by (4.5-13). 

Expressions (4.10-1) and (4.10-3) are special cases of results obtained by 
Middleton who has studied the general theory of the quadratic rectifier by 
using the Van Vleck-North method, described in Section 4.7. 

As an example to which the theory of Section 4.9 may be applied we con¬ 
sider the sine wave plus noise, (4.1-13), to be applied to the u -law rectifier 


I = 0, 


V < 0 


/ = v\ V > 0 

From the table in Appendix 4.4 it is seen that 

F(iu) = T(u -b 1 )(iu) 


(4.10-4) 


—r—1 
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a nd that the path of integration C runs along the real axis from 
beeves lndentation at the °rigin. The integral (4.JHJ) for U 




jn+k~9 1 



ro + 1 ) J J „(/*)«-<*•«>•* du 


(tr* 


12 


+ 1 ) 


2T 


2 - k - 


(k + n - v \ 

E +^'■(—2—>■+>*-*) 


p* 

2\po 


(4.10-5) 


wdiere the integration has been performed by expanding J n (Pu) in powers 
of u and using 


/ „~ a “ 2 2X—1 7 . _X»T — 

J e u du = ie a 


sin X7rr(X) 


a 


-x 


(i - e - a ")r(\) 


(4.10-6) 


Z7re 


—Xtr 


a x r(l - X) 

it being understood that arg u = 0 on the positive portion of C. 
From (4.9-9), the dc component of I is 


hoo = 


nuuo (*.Y‘ f ( ’ , t 
+ ,r, r5 ;1; -v 


2 r 


(4.10-7) 


which reduces to the expression (4.2-3) when v = 1 f or the linear rectifier 
(aside from the factor a). 

When the input (sine wave plus noise) is confined to a relatively narrow 
band, and when we are interested in the low frequency output, consideration 
of the modulation products suggests that we consider the difference products 
from the products of order (0, 0), (0, 2), (0, 4), • • • (1, 1), (i, 3 ), • •. (2, 0), 

(2, 2), • • • etc. where the typical product is of order (», k). The orders 
(0, 0) and (2, 0) give the dc and second harmonic and hence are not con¬ 
sidered in the computation of W c (f). Of the remaining terms, either (0, 2) 
or (1, 1) gives the greatest contribution to the series (4.9-12) and (4.9-10) 
for W c (f) and ^ c (r). The remaining terms contribute less and less as n and 
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k increase. The low frequency portion of the continuous portion of the 
output power spectrum is then, from (4.9-12), 


WJJ) = 


tiozGzif) + 7~. hl 4 Gi(J) + • • • 

Zl 4! 

+ - h\i\Gi(f - /„) + 6'i(/ + /.)] + 3 4 , h\ 3 [Gs(J - fo) (4.10-8) 


4- G$(J -T fo)] + ^^Gzif — 2fo) -j- 6 * 2(7 4- 2/o)] + 


From Table 2 of Appendix 4C we may pick out the low frequency portions of 
the 6’s. It must be remembered that G m {x) is an even function of x and 
that 0 < /« f Q . 

As an example we take the input noise F v to have the same w(f) and 
\J/(t) as Filter a, the normal law filter, of Appendix 4C, so that 



_ _ h _ -</-/ 0 > 2 / 2* 2 

“ ay/2r 


and assume that the sine wave signal is at the middle of the band, giving 
P = 2tt/o . Thus, from (4.10-8), for low frequencies and the normal law 
distribution of the input noise power, 





e " /2/4ff2 


1 

64a y/2 tt 



-/ 2 /8<72 




-/ 2 / 2 <y 2 



_ 1 _ 

4 a \/ 67r 


^13 Po ^ 


-/ 2 / 6 <t 2 


(4.10-9) 


1 ^ /2 .2 -/ 2 /4<r2 , 

+ 4<r V / ^ A22 ’ / '° + ‘" 

Although we have been speaking of the v-law rectifier, equation (4.10-9) 
gives the low frequency portion of \V e (f), corresponding to a normal law 
noise power, for any non-linear device provided the proper h n k s are inserted. 

When we set v equal to one in the expression (4.10-5) for h n u we may ob¬ 
tain the results given by Bennett. Middleton has studied the output of a 
biased linear rectifier, when the input consists of a sine wave plus noise, and 
also the special case of the unbiased linear rectifier. He has computed the 
output for a wide range of the ratios P 2 /\p 0 , B 2 /\Jy 0 where B is the bias. In 
order to cover the entire range he had to derive two series for the corre¬ 
sponding h n k s, each series being suitable for its particular portion of the 
range. 
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A ® pec,a !, i case of (4-10-9) occurs when noise alone is applied to a linear 
rectifier. The low frequency portion of the output power spectrum is 


Wc(J) = +2 ± t 

2 ) m ( 2 ) m 

^ p—/ 2 /4 TTUJ 2 


TT mT1 

ml ml 

<r\/ 4mir 


tt" 3/2 r 

i e~' w + 

» 

^ -{2/^2 


2<7 [ 

64V2 6 

(4.10-10) 


-4- —-— I 1 

+ 2S6V3 + • • - J 

where we have used (4.7-6) and Table 2 of Appendix 4C. 

The correlation function of 


V s = P cos pt + Q cos qt , 

# 

where p and q are incommensurable, is 

J a{PV « 2 + V 2 + 2uv cos Pt) X MQVu 2 + v 2 + 2uv cos qr) 
From equations (4.9-16) and (4.9-17) it is seen immediately that 

h<m = 2^ / c F ^)M Pu )MQu)e~^ du (4.10-11) 

is the d.c. component of I when the applied voltage is 

P cos pt + Q cos qt + V N . (4.1-4) 

J. R. Ragazzini has obtained an approximate expression for the output 
power spectrum when the voltage 


v = Vs + v„ 

V a = Q{ 1 + r cos pt )cos qt 


(4.10-12) 


is impressed on a linear rectifier. In terms of our notation his expression 
for the continuous portion of the power spectrum is (for low frequencies) 


W C U) 


1 

7r 2 a 2 (Q 2 + 2\po) 



Wc(J) given 
(4.5-17) for 


by equation 
square law device 



(4.10-13) 


The a is put in the denominator to cancel the a 2 in the expression (4.5-17). 
We take the linear rectifier to be 


/ 0 , V < 0 
IT, 0 < I 


(4.10-14) 


and replace the index of modulation, k , in (4.5-17) by r. 

46 Equation (12), “The Effect of Fluctuation Voltages on the Linear Detector.” Proc. 
I.R.E., V. 30, pp. 277-288 (June 1942). 


152 


Ragazzini's formula is quite accurate when the index of modulation r is 
small, especially when y = Q 2 /(2\p 0 ) is large. To show this we put r = 0 
in (4.10-13) and obtain 


W 


•w = .wiiM ~ f) + Q2uif < +/) 



w(x)w(J 



(4.10-15) 


where f Q = q/(2ir). This is to be compared with the low frequency por¬ 
tion of I V c (f) obtained by specializing (4.10 8; to obtain the output power 
spectrum of a linear rectifier when the input consists of a sine wave plus 
noise. The leading terms in (4.10-8) give 

W c (j) = h 2 n [w(f q - f) -f w(f q +f)\ 

f2 1 f +0 ° (4.10-16) 

H- «02 T / w(x)w(f — x) dx 


I he values of the //’s appropriate to a linear rectifier are obtained by set¬ 
ting v = 1 in (4.10-5) and noticing that Q now plays the role of P. 


>'n = 2; -y) 

Jio 2 = (27rpo)~ 112 1 Fi(%; 1 ; — y) 


(4.10-17) 


y = Q 2 /Wo) 


Incidentally, the lirst approximation to the output of a linear rectifier 
given by (4.10-16) is interesting in its own right. Fig. 9 shows the low fre¬ 
quency portion of W c (f) as computed from (4.10-16) when the input noise 
is uniformly distributed over a narrow frequency band of width /3, f q being 
the mid-band frequency, hn and // 02 may be obtained from the curves 
shown in Fig. 10. In these figures P and x replace Q and y of (4.10-17) in 
order to keep the notation the same as in Fig. 8 for the square law device. 

Ihese curves may also be obtained from equations (33) to (43) of Bennett’s 
paper. 

The following values are useful for our comparison. 

When x = 0 When x is large 

h n = 0 h n = 1/tt (4.10-18) 

/?02 — ( 27 ^ 0 ) 1/2 /?02 — 

The values for large x are obtained from the asymptotic expansion (4 B — 3) 
given in Appendix 4 B. 
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LOW FREQUENCY OUTPUT OF LI NEAR RECTIFIER 
APPROXIMATION -SECOND ORDER PRODUCTS ONLY 



INPUTS V = P COS 2 fffpt ♦ NOISE 
OUTPUT = I = 

OUTPUT D.C- = PS,* p W„ h 02 


<-ET C = = < Ph 02>' 


4 P 


P/2 


FREQUENCY 


Fig. 9 


AVC SINE WAVE POWER 


AVE. NOISE POWER 2pw 0 


INPUT SPECTRUM 


INPUT NOISE 



Fig. 10—Coefficients for linear detector output shown on Fig. 9 


Pha2 


-vl 


,F.(i; 1; -x) A„ - 1 ,F,(*; 2; -x) 


We make the first comparison between (4.10-15) and (4.10-16) by letting 
—> oo. It is seen that both reduce to 


Wc(J) = [»(/, -f) +w(J v +f)} 


(4.10-19) 










which shows that the agreement is perfect in this case. Next we let Q — 0. 
The two expressions then give 

WJJ) 

where A = 7 r for Ragazzini’s formula and A = 4 for (4.10-16). Thus the 
agreement is still quite good. The limiting value for (4.10-16) may also 
be obtained from (4.7-8). 

Even if the index of modulation r is not negligibly small it may be shown 
that when Q —> * IE e (f) still approaches the value given by (4.10-19). 
Ragazzini’s formula gives a somewhat larger answer because it includes the 
additional terms, shown in (4.5-17), which contain k~/4, but this difference 
does not appear to be serious. If the Q~ 4 - 2\po in the denominator of (4.10- 
13) be replaced by Q" -f- %Q k“ -f- 2\J/o the agreement is improved. 

APPENDIX 4A 

Table of Non-linear Devices Specified by Integrals 

Quite a number of non-linear devices may be specified by integrals of the 
form 


= _L_ f 

A2tt\Po 


4-00 


w(x)w(J — x) dx 


00 



(4A-1) 


where the function F(iu) and the path of integration C are chosen to fit the 
device.* The table gives examples of such devices. Some important cases 
cannot be simply represented in this form. An example is the limiter 


I = — aD, 
I = aV, 

I = aD, 

which may be represented as 


V < -I) 
-D < V < D 
D < V 




sin Vu sin Du 



= -aD + 



sin Du 


du 

u 2 


(4A-2) 


(4A-3) 


where C runs from - « to -f « and is indented downward at the origin. 

This is not of the form assumed in the theory of Part IV. However it 

appears that it would not be difficult to extend the theory in the particular 
case of the limiter. 


* Reference 50 cited in Section 4.9. 
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Non-Linear Devices Specified by Integrals 


I = — [ F(iu)e xVu du 
2ir J c 


/ 

F(iu) 

C 

Type of Device 

I = aV n , n integer 

a ill 
(iu) n * i 

Positive Loop 
around u = 0 

nth power device 

I — a(V — B) n , n 
integer 

j ” ! ,-iuB 

| ( iu) n 

Positive Loop nth power device 

around u = 0 with bias 

1=0, V < 0 

/ = aV, 0 < V 

or a 

(iu)* u* 

Real u axis from 
— °c to 4- oo with 
downward in¬ 
dentation at 

u = 0 

Linear rectifier 
cut-off at 

V = 0 

1 = 0, V < B 

I = a(V - B\ v , 

V > B j 

v any positive number, 

ar(K + 1) . B 

(iu)"+i 

a 

t'th power recti- 
' fier with bias 

7 = 0, V < 0 

I = aV, 0 < V < D 
I = aD, D < V 

Qf( 1 - C~ iuD ) 

(in)* 

Linear rectifier 
plus limiter 

o o 

V A 

K K 

k 

o ^ 
il II 

k^ 

F(p) = [ e~p‘v(l)dt 

Jo 

a 



APPENDIX 4B 


The Function \F x {a\ c; x) 

In problems concerning a sine wave plus noise the hypergeometric func¬ 
tion 


az 


Ma; «; ,)- I + =, + £±jj t +■■■■ 


(4B-1) 


arises. Here we state some of its properties which are of use in the theory 
of Part IV. Curves of iFi(a; c; z) are given for a = — 4, — 3.5 • • • , 3.5, 
4.0 and c = — 1.5, — .5, + .5, 1, 1.5, 2, 3, 4 in the 1938 edition, page 275, 
of ‘‘Tables of Functions”, by Jahnke and Emde. A list of properties of the 
function and other references are also given. In addition to these refer¬ 
ences we mention E. T. Copson, “Functions of a Complex Variable” (Ox¬ 
ford, 1935), page 260. 

If c is not a negative integer or zero 


iFi(a; c; z) = e\F x (c — a; c; — z). 


(4B-2) 
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When R (z) > 0 we have the asymptotic expansions 


1 * 1 ( 0 ; c ; z) 


r( 
f( 


(cv r 

a)z c ~° L 


1 4 - 


-f 


(1 - a)(2 


(1 — a )(c — a) 
1 !z 

- a){c ~ a)(c - 
2!z 2 


a 4-0 + 


v ( \ r (0 r, 

- 3I " ru - a 1_ + n* 


c) 


(4B-3) 


+ 


a (a + 1)(1 4- a — c){2 + a — c) 

2!z 2 


4 - 


Many of the hypergeometric functions encountered ma\- be expressed in 
terms of Bessel functions of the first kind for imaginary argument. The 
connection may be made by means of the relation 51 


\F i l v 4“ -z ; 2v T 1 



2 r(v + 



together with the recurrence relations 


(4B-4) 



1. 

a 

(a - c) 



2. 

ac 


(c - a)z 


3. 

a 



1 — c 

4. 


— c 

— Z 


5. 


a — c 


c — 1 

6. 



(c — a)z 

c(c - 1) 


For example, the first recurrence relation is obta 


aF(a 4* 1; c\ z) 4- (a — c)F(a — 1; c; z) 


c — 2a — z 
— c(a 4- z) 
c — a — 1 
c 

1 — a — z 
c(l — c — z) 

ined from line 1 as follows 


4- (c — 2a — z)F(a; c; z)= 0 (4B-5) 

These six relations between the contiguous i/h functions are analogous to 
the 15 relations, given by Gauss, between the contiguous 2 F i hypergeo me trie 
functions and may be derived from these by using 


1 * 1 ( 0 ; G 2 ) = Limit 2 * 1 ^ 2 , b ; c; Z -j (4B-6) 

A recurrence relation involving two \F\S of the type (4B-4) may be ob¬ 
tained by replacing a by a 4- 1 in the relation given by row four of the table 

61 G. N. Watson, “Theory of Bessel Functions” (Cambridge, 1922), p. 191. 
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k. % 


290 


and then eliminating ^(a + 1 ;c;z) from this relation and the one obtained 
from row 3 of the table. There results 


iFiO; c; z) iF x {a\ c — 1; z) + + 1; c + 2 ) (4B-7) 


Setting j/ equal to zero and one in (4B-4) and a equal to J, c equal to 2 in 
(4B-7) gives 

lFl (f ; 3 i 2 ) = 4z~V 2 /j (4B-8) 

Q i 2; .) - [/. (l) - 7, (0] 

Starting with these relations the relations in the table enable us to find 
an expression for i/q (n -f- m; z) where n and m are integers. A number 
of these are given in Bennett’s paper. In particular, using (4B-2), 

+ *Ti (|)] • (4B-9) 



APPENDIX 4C 


The Power Spectrum Corresponding to \pr 
Quite often we encounter the integral 


L 


(4C-1) 


where ^(r) is the correlation function corresponding to the power spectrum 
w(f). From the fundamental relation between w(f) and ^(r) given by 
(2.1-5), 


Gi(/) = 


(4C-2) 


The expression for the spectrum of the product of two functions enables us 
to write G n (f) in terms of w(J). We shall use the following form of this 
expression: Let F r (f) be the spectrum of the function <p r ( t) so that 


< Pr ( r ) = 

[ + ~F r (f)e 2ri/r df, 


QO 


r+ co 

Fr ( J ) = 

/ MT)e- M " dt 

L_oo 
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Then 


f 2r,/r dr = [ Fi(x)F 2 (f — *) 

•*— ao J— oo 


dx (4C-3) 


i.e., the spectrum of the product ^i(r)^ 2 (r) is the integral on the right. 
If <fi (r) and ^ 2 (r) are real even functions of r, (4C-3) may be written as 

jf *?i(t)*? 2 (t) cos 2ttJt dr = i J Fi(x)F 2 (J — x) dx (4C-4) 

In order to obtain G 2 (f) we set v>i(r) and <- 2 (r) equal to ^(r). We may 
then use (4C-4) since /(r) is an even real function of r. When <^,.( 7 -) is an 
even real function of r we see, from the Fourier integral for F r (f), that F r (f) 
must be an even real function of /. We therefore set 

2F r (f) = w(f), r= 1,2 
and define ^(/) for negative / by 


f) = U'(/) 


(4C-5) 


Equation (4C-4) then gives 


< w > - S L 


4-00 


OO 


w(x)w(f — *) J* 


1 r 7 

= g jf w{x)w(J — x) dx 

1 r°° 

+ J J w(x)w(J H- a:) Jx 


(4C-6) 


where in the second equation only positive values of the argument of w(f ) 
appear. 

In order to get G Z (J) we set ^i(r) equal to »/(r), 2Fi(/) equal to w(f), and 
w) equal to +\r). Then 


Fi(f) = 2 f <^ 2 (t) cos 27r/r Jr 

Jo 


= 2G 2 (f) 


and from (4C-4) we obtain 


w>-!£ 


+00 


iv{x)G 2 (J — s) Jz 


00 


1 r + °° r +0 ° 

= i6^ JL. w W w U - y ) 


(4C-7) 
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Equation (4C-7) suggests that we may write the expression for G 2 (f ) as 

(/) = \ j_ x “ *) dx (4C-8) 

This is seen to be true from (4C-2) and (4C-6). In fact it appears that 

G n (f) = \ f w(f - x)G„-i(x) dx (4C-9) 


might be used for a step by step computation of G„(f). 

\\ e now consider G n (J) for the case of relatively narrow band pass filters. 
As examples we take filters whose characteristics give the following w(f)'s 
and ^(r)’s 


Table 1 


Filter 

iv{f) for / > 0 

J'G) 

a 

e -(/-/0) 2 /2.» 

cy/lir 

cos 2» for 

b 

J'O a 1 

tt «* + (/- /„)* 

vtoe -2r “ lr| cos 2x/ 0 r 


u>(f) = w 0 = to/P for 


c 

/o-2</</»+2 

sin x/3r 

V^o- cos 2tjot 

TT&T 


w(f) =0 elsewhere 



We shall refer to these filters as Filter a, Filter b, and Filter c, respectively. 
All have / 0 as the mid-frequency of the pass band. The constants have 
been chosen so that they all pass the same average power when a wide band 
voltage is applied: 

\f/ 0 = w(f) df = mean square value of /(/) or V(t) 

Jo 

and it is assumed that /o » cr, /o a, fo 0 so that the pass bands are 
relatively narrow. 

Expressions for G n (f) corresponding to several values of n are given in 
Table 2. When n = 1, Gi(J ) is simply w(J)/ 4. Go(f) is obtained by set¬ 
ting n = 2 in the definition (4C-1) for G n (f), squaring the ^(r)’s of Table 1, 
and using 

cos 2 2tt/qt = \ + 4 cos 47r/or 
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d +% >f>«/z „ (/-{( + » ft)"- 







0 4 


The expression for G,(f) given in Table 2 corresponding to Filter c is 

a and b glVe g °° d ^-tions around 
/ 0 and/ - 2/ 0 where G 2 (/) ,s large. However, they are not exact because 

terms involving/ + 2 f 0 have been omitted. It is seen that all three G 2 ’s 

behave ,n the same manner. Each has a peak symmetrical about 2/„ whose 

IS t " 1Ce that of ‘ he or ‘g maI w (f)> is almost zero between 0 and 2/ 0 , 

‘ ', nscs to a I )eak at 0 whose height is twice that at 2/ 0 . 

(/3( - f) 1S ol)tained by cubing the *(r) given in Table 1 and using 

COS 2tt f 0 T = f COS 2nfoT + J cos 67 t/ 0 7-. 

I-rom the way in which the cosine terms combine with cos 2 tt/t in (4C-1) we 
see that G 3 (f) for our relatively narrow band pass filters, has peaks at f„ 

an( /° ’ the arst P eak being three times as high as the second. The ex- 

pressions given for G 3 (f) and G t (f) are approximate in the same sense as are 

those for 6 2 (/). It will be observed that the coefficients within the brackets, 

for I-liters a and b, are the binomial coefficients for the value of n concerned. 

Thus for n = 2, they are 2 and 1, for n = 3 they are 3 and 1, and for n = 4 
they are 6, 4, and 1. 

The higher G n (fY s for Filters a and b may be computed in the same way 
The integrals to be used are 


L 


—2n(noT) 2 


cos 2ttJt dr = 


e -J 2 l2no 2 

2a\/ 2mr 


L 


<30 


— 2 nrar 


cos 2ttJt dr = 


1 


na 


2tt n 2 a 2 -f f 2 


In many of our examples we are interested only in the values G n (f) for 

/ near zero, i.e., only in that peak which is at zero. It is seen that G n (f) 

has such a peak only when n is even, this peak arising from the constant 
term in the expansion 


cos 


2k 


x = 2^1 [ cos 2kx + 2k cos 2 ( k ~ 1)* + ( WW - 1) 


cos 2(k — 2)x 


+ 


• • 


+ 


( 2 *)! 


(* - UK* + m cos + k 


(2k )! 1 

!k!2 J 
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1. Introduction. In 1827 an English botanist, Robert Brown, noticed that 
small particles suspended in fluids perform peculiarly erratic movements. This 
phenomenon, which can also be observed in gases, is referred to as Brownian 
motion. Although it soon became clear that Brownian motion is an outward 
manifestation of the molecular motion postulated by the kinetic theory of mat¬ 
ter, it was not until 1905 that Albert Einstein first advanced a satisfactory 

theory. 

* 

The theory was then considerably generalized and extended by the Polish 
physicist Marjan Smoluchowski, and further important contributions were 
made by Fokker, Planck, Burger, Ftirth, Ornstein, Uhlenbeck, Chandrasekhar, 
Kramers and others [l ]. On the purely mathematical side various aspects of 
the theory were analyzed by Wiener, Kolomgoroft, heller, Levy, Doob, and 
Fortet [2]. Einstein considered the case of the free particle, that is, a particle 
on which no forces other than those due to the molecules of the surrounding 
medium are acting. His results can be briefly summarized as follows. 

Consider the motion of the projection of the free particle* on a straight line 
which we shall call the .r-axis. What one wants is the probability 


r 


P(x 0 j .t; t)dx 


that at time t the particle will be between X\ and x? if it was at rr 0 at time / = 0. 

Einstein was then able to show that the “probability density” P(x 0 \ x; /)§ must 

satisfy the partial differential equation 

OP d-P 

(1) - = D-, 

dl Ox 2 

where D is a certain physical constant. The conditions imposed on P are 



(a) 


P ^ 0 


(2) 

( b) 

/_>• 

x; t)dx = 1 



(c) 

lim P(x 0 x; t) = 0, 

for x 


t—0 


* This is an extended version of an address delivered at the annual meeting of the Association 
at Swarthmore, Pennsylvania, December 26 - 27 , 1946 . 

t John Simon Guggenheim Memorial Fellow. 

X I n what follows we shall identify this projection with the particle itself and hence consider the 
so-called one-dimensional Brownian motion. 

* notati °n PM *: t) and P(n | m; s) for conditional probabilities is that used by Wang and 
Lhlenbeck [l\. It does not conform with the notation adopted in the statistical literature. Had we 
adopted the latter notation we would write P(x; /|x 0 ) and P(m; sin). 
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Conditions (a) and (b) are the usual ones imposed upon a probability density 

and condition (c) expresses the certainty that at 1 = 0 the particle was at *. 
It is well known that ( 1 ) and ( 2 ) imply that P 1 


(3) 


P(x 0 x; t ) = 


1 


2y/ 7 rDt 


e ~~ C x — i o) 2 /4D< 


and that the solution ( 3 ) is unique. 

I he greatness of Einstein’s contribution was not, however, solely due to 
the derivation of fl), and hence (3). From the point of view of physical ap! 

" aS CqUa " y ’ ° r Perh3pS 6Ven m ° re ’ im P or t an t that he was able to 




2 RT 

~nJ 


j 


\\ here R ,s the universal gas constant, T the absolute temperature, N the 
Avogadro number, and/the friction coefficient. The friction coefficient /, in the 
case the medium is a liquid or a gas at ordinary pressure, can in turn be ex¬ 
pressed in terms of viscosity and the size of the particle [ 3 ]. 

It was relation (4) that made possible the determination of the Avogadro 
number from Brownian motion experiments, an achievement for which Perrin 
was awarded the Nobel prize in 1926. However, the derivation of (4) belongs 

to physics proper, and presents no particular mathematical interest; we shall 
therefore not he concerned with it in the sequel. 

As soon as the theory for the free particle was established, a natural ques¬ 
tion arose as to how it should be modified in order to take into account outside 
forces as, for example, gravity. Assuming that the outside force acts in the 
direction of the x-axis and is given by an expression F(x), Smoluchowski has 
shown that (1) should in this case be replaced by 



dP Id d 2 P 

- = ~ — — (PP) + D - 

dt f dx dx 2 


Two cases of special interest and importance are: 

P(x) = —a; field of constant force (for example, gravity). 

F(x) => —bx; elastically bound particle (for example, small pendulum). 

At this point it must be strongly emphasized that theories based on (1) and 
(5) are only approximate. They are valid only for relatively large i and, in the 
case of an elastically bound particle, only in the overdamped case, that is, when 
the friction coefficient is sufficiently large. These limitations of the theory were 
already recognized by Einstein and Smoluchowski but are often disregarded 
by writers who stress that in Brownian motion the velocity of the particle is 
infinite. This paradoxical conclusion is a result of stretching the theory beyond 
the bounds of its applicability. An improved theory (known as “exact”) was 
advanced by Uhlenbeck and Ornstein and by Kramers. The Uhlenbeck-Orn- 
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stein approach was further elaborated by ( handrasekhar and L)oob. 

In what follows we shall be concerned with a discrete approach to the Ein- 
stein-Smoluchowski (approximate) theory. This approach was first suggested 
bv Smoluchowski himself; it consists in treating Brownian motion as a discrete 
random walk. Smoluchowski used this approach only in connection with a free 
particle but we shall also treat other classical cases. Moreover, a re-interpreta¬ 
tion of one of the discrete models will allow us to discuss the important question 
of recurrence and irreversibility in thermodynamics. 

The main advantages of a discrete approach are pedagogical, inasmuch as 
one is able to circumvent various < onoeptual difficulties inherent to the continu¬ 
ous approach. It is also not without a purely scientific interest and it is hoped 
that it may suggest carious generalizations which will contribute to the develop¬ 
ment of the C alculus of Probability. 

2. The free particle. Imagine a particle which moves along the .r-axis in such 
a way that in each step it can move either A to the right or A to the left, the du¬ 
ration of each step being r. I he fact that we are dealing with a free particle is 
interpreted by assuming that the probabilities of moving to the right or to the 
left are equal, and hence each equal Instead of P(xo,x; t) we now consider 
P(«Ajn?A; st) = Pin rn ; s) which is the probability that the particle is at wA 
at time st, if at the beginning it was at //A. Noticing that P(?i' w; s) is also the 
probability that after s games of “heads or t ails" t he gain of a player is v = m — n, 
we can write 


(6) P(n\m\s) 



l 0 


otherwise. 


Suppose now that A and r approach 0 in such a way that 


(7) 


A 2 

2 r 


= D, 


tiA 


Xo, 


ST = t. 



+ 5 is even, 


It then follows from the classical Laplace-De Moivre theorem [4] that 

\ r zi 

(8) lim P(n\m\s)= -= I r (l ~ I o) , / 4I) ‘(/x, 

Xj<m^<r; TTDt J XI 

and hence the fundamental result of Einstein emerges as a consequence of what 
in probability theory we call a “limit theorem.” 

It is both important and instructive to point out a striking formal connec¬ 
tion between the discrete (random walk) and the continuous (Einstein) ap¬ 
proaches. We notice that P(n\m; s) satisfies the difference equation 

(9) P(n | m \ s+ 1) = $i>(„ \ m - 1; j) + §P(n | m + 1; s), 



372 


RANDOM WALK AND THE THEORY OF BROWNIAN MOTION [September, 


which we write in the equivalent form 


00 ) 


P(n& 1 mS- (s + 1 )t) _ P(„a| otA; St) 


= A’ | (m + 1)A; sr) - 2P(wA | mA;sr) + P(„A | (m - 1)A ; st) 


In the limit (7) this difference equation goes over formally into the differential 
equation 



dP 

dt 


d 2 P 

dx 2 


which as noted before was the basis of Einstein’s theory. This formal connec¬ 
tion between the two approaches can be made rigorous, but we shall not go 
into this. However, we shall use it as a guiding heuristic principle in constructing 
models of Brownian motion when outside forces are taken into account. 

Finally, let us mention that it is the relation 


A 2 



which is responsible for the conclusion that the velocity of a Brownian particle 
is infinite. In fact, in our model, the ratio A/r plays the role of the instantaneous 
velocity and it obviously approaches infinity as A—>0. 

•3- Particle in a field of constant force and in the presence of a reflecting 
barrier. We again consider random walk along the *-axis in which a particle can 
move A to the right or A to the left, the duration of each step being r. We now 
introduce the following new assumptions: 

(a) The probability of a move to the right is q = \-(3A, and consequently the 
probability of a move to the left is p = \- b/3A. Here is a certain physical con¬ 
stant, and A must be chosen sufficiently small so that q> 0. 

(b) When the particle reaches the point * = 0 (reflecting barrier) it must, in 
the next step, move A to the right. 

Without the assumption (b) the problem would be quite simple and of no 
great physical interest. In actual experiments with heavy Brownian particles, 
like those of Perrin, the bottom of the container acts as a reflecting barrier and 
the elucidation of its influence on the Brownian motion is of considerable theo¬ 
retical interest. 

This problem has been solved by Smoluchowski, on the basis of his equa¬ 
tion (5) but we shall show that one can solve the discrete problem and obtain 
Smoluchowski’s result by passing to a limit. 

Assuming that the particle starts from nA^O (n an integer) we seek an ex¬ 
plicit expression for P(n\m; s). We first notice that P(n\m; s) satisfies, for 



29 


1947) RANDOM WALK AND THE THEORY OF BROWNIAN MOTION 373 


m'^2, the difference equation 

(12) P(n | nr, s -f 1) = qP(n \ m — 1; s) + pP(n \ m + 1; s), 

and that for m = 1 and m =0 we have 

(12a) P( n \ 1; * + 1) = P( n \ 0; s) + pP(n | 2; s), 

(12b) P{n\ 0; s + 1) = pP(n \ 1; s). 

We also have the initial condition 


(1^) P(n | m \ 0) = 5(m, ?i), 

where 5(m, n) denotes, as usual, the Kronecker delta. 

1 he difference equation (12) when rewritten in the form analogous to (10) 
can be shown to go over formally (in the limit A—K), r—»0, A 2 /2t = D , n&—+x 9t 
?nA—>x, sr = t) into the differential equation 



dP d 2 P dP 

- = D -b 4 &D -, 

dt fix 2 dx 


which is of the form (5) with F(x) = -a = -4(3Df. 

To find P(n \ m; s) we use a method which is basic in the study of the so-called 
Markoff chains, of which our problem is but a particular example, and which in 
its essentials goes back to Poincare [5]. Let (p) t be the (infinite) vector 




~P(n | 0; s)~ 
P(n | 1; s) 
P(n | 2; s) 


and A the infinite matrix 




0 p 0 0 0 • • • 

1 0 p 0 0 • • • 

0 q 0 p 0 • • • 

0 0 q 0 p • • • 


Then, the difference equation (12), (12a) and (126), can be written in the 
torm as 


matrix 


(17) 


(?).+i = A(p)„ 


Thus it follows immediately that 
(18) 


(p). = A ‘(p)o, 



2*3 00 
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where (p) 0 is the vector 




I 


1 being the nth component, the components being numbered from zero on. In- 
terpreting (18), we see that 

(*^) P( n | m \ *) — the (m, n) element of A \ 

1 o make use of (19), we notice that if and we consider the finite matrix 

A r , which is the upper left R by R submatrix of A, then for m<R 


(20) the ( m , n) element of a' = the ( m, n) element of Ar, 
or equivalently, 

(21) the ( m , n) element of A * = lim of the (m, n ) element of Ar. 


For each R there exist matrices P R and Q R such that 

(22) P r Q r = / 


and 






0 


A*-iCK)J 


Qr » 


Ao (R), Ai (R), • • , X«_i(i?) being the eigenvalues of the matrix Ar. To simplify 

the notation we write A, for X ; (i?). 

Multiplying the matrix Ar s times by itself and making use of (22), we ob¬ 
tain 



and one can calculate the (m, n) element 


of A% explicitly provided the diag- 
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onalization (23) can be performed explicitly. This indeed is the case. 

Let ( x ) 0 , (x)i, • • • , (*)*_i be the “right” and ( y) 0 , (y) i, • • •, (y)*_, the 
“left” eigenvectors belonging respectively to the eigenvalues X 0 , Aj, • • , X«_i. 
In other words, for k=0, 1 , • • ♦ , R — 1 , we have 

Aft(x) k = \k(x ) k , 

A R (y) k = \k(y)k, 

where A' R is the transpose of A r. 

Suppose furthermore that the vectors can be so normalized that 

( 25 ) (*)*•(?)* = 1 . k = 0 , 1 , • • • , R - 1 , 

where (x)*-(y)* is the inner (dot) product of the vectors. Since it is well known 
that 

(*)r(y)k = 0 for A, 5 * A* 

we see that, in the case when all the eigenvalues are distinct, we can take as P R 
the matrix whose columns are the vectors (x)k and for Qr the matrix whose rows 
are the vectors ( y) k . 

In order to determine the eigenvalues and the right eigenvectors we consider 
the system of linear equations 

px i = A To 

To T p t 2 = Ati 

(26) qx x -f px 3 = At 2 


qxR- 2 

and the extended infinite system 


— At^_j, 


(27) 


P X\ = At 0 

Xo + P To = Ati 

*****•••• 
qxR-\ + px R+x = At r 


If we can find non-trivial solutions of (27), for which 


(28) 


x R = 0, 


we will have found solutions of (26). 

J\Z n ir tHat , (28) Wi " y!eId an equation in X which has R distinct roots 
adH t ° Ur Procure gives us all eigenvalues, and consequently all right 
genvectors. Multiplying the members of the equations of (27) by 1 
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2 , s 2 ,... , and adding, we obtain formally 


^ « 00 
*oZ + q Z XkZ k+1 + *kZ k ~' = A Z 


XkZ 


or, upon introducing the abbreviation, 


(29) 


/GO = H X k Z k , 


we have 


(30) 


*o 2 + qz[f(z) - x 0 ] 4- — f/(z) - x 0 ] = X/(z) 


From (30) we obtain 


(31) 


f( Z ) = — Xo 

<7 


{- 


1 4- 


1 — Xz 

qz 2 — Xz -f p 


}■ 


and since this function is analytic in the neighborhood of zero the formal pro 
cedure used above can be justified. 

Let pi and p 2 be the reciprocals of the roots of 


(32) 

We have then 


(33) 


qz 2 — \z + p = 0. 


/GO = — * 0 


{- 


1 + 


1 — Xz 


p(l — Piz)(l — p 2 z) 


— P2Z)l * 


and introducing partial fractions, 


1 - *z 1 X - pi 1 1 p,-X 1 

(34) ----1- 

P( 1 “ Piz)(l — P2z) P P 2 — Pi 1 — piZ P P 2 — Pi 1 — P 2 Z 


1 X - Pi 


Thus 


(35) 


_ xo / X — 
Q \ P2 — 


X — Pi * P2 — X 

-Pi 4 - 

P2 — Pi P2 “ Pi 


-x A 

- P2 I 

T Pi / 


for k ^ 1, 


and, in particular, the equation x*=0 assumes the form 


(36) 


X — pi R P2 — X R 
-pi 4-p 2 = 0 

P 2 — Pi P2 — Pi 


Equation (36) must now be solved for X. Assuming i? to be even, and seeking 
solutions in the form 


X = 2\/pq cos 0, 
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we are led to the equation 

tan RQ _ 1 

tan 0 2 p — 1 

For R>(2p — \)~ l this equation is seen to have R — 2 distinct roots, 
0 i, 02 , • • • , 0/i— 2 , which lie in the subinter'vals 

, £ + —Y 

\R 2 R R 2R) 

where j ranges through the integers from 1 to R—\ with the exception of j = R/2. 
Corresponding to 0i, 0 2 , • • • , 0ft-2 we have R — 2 distinct eigenvalues, 

X* = 2VM cos 0*, k = 1, 2, • • • , R — 2, 

and the components of the right eigenvector belonging to X* can be written in 
the form 


w here 


(m) 

X k 




sin W0* 

2/3A - 

sin 0* 




M > 0, 
M = 0, 


and dk is a normalizing constant which will be fixed later. For sufficiently large 
R the remaining eigenvalues X 0 and \r-i can be shown to be given by the 
formulas 

Xo = 2 y/pq cosh d 0t \r-i = — X 0 , 
where 8 0 is the only positive root of the equation 


tanh Rd 1 


tanh 6 2 p — 1 


The components of the corresponding right eigenvectors are given by the ex¬ 
pressions 


(m) 

Xo 





cosh mOo — 20A 


sinh mdo 
sinh 6 q 


cosh Oo 



(m) 

XR -1 


flft-l( 




cosh m 6 o — 2/3A 


sinh tndo 
sinh do 


cosh d 0 



It remains now' to find the left eigenvectors. This can be accomplished in exactly 
the same manner and we merely quote the results. We obtain 


O U 4 
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.. (m) _ 7 (P\ m/2 ( sin mS k \ 

' k ) ( cosm0* - 2/3A-- cos©* ) 

' ? ' ' sin 0* / 


forw== °. 1 . R- 1; * = 1. 2. ■ • • , R —2, and 


(m) , ( P \ m/ V sii 

>'o — ^—y ^cosh m0 o — 2/3A — 


sinh 


sinh do 


cosh 6 0 


Vl (m) _ Z, / i\ m /^\ m/ V i /, sinh 

- 0*-i( — 1) ( — 1 ( cosh mdo — 2/3A- cosh 6, 

V - sinh do 

To satisfy the normalization conditions (25) we must have 


> 


(37) 

*£* ^ 
/ 

? + S/m(0*) 

v m= 1 t 

/?-1 

) = 1, k=l,2,---,R-2, 

i 

(38) 

where 

fl*£* f 

? + Fm(do) 

m= 1 > 

) = 1, k = 0,R-\, 

and 

/-(©) = 

cos w0 — 2/3A 

sin w0 

—-cos 0* 

sin 0 


j? , sinh md 

Fm\d) cosh md — 2/3A-cosh 6, . 

sinh d ° 

W e can, of course, put a 0 = ai = • • • = clr_ , = 1, and determine the &’s from (37) 

and (38). Referring back to (19), (20), and (24), and recalling that columns of 

Pr are the right eigenvectors (#)*, and the rows of Qr are the left eigenvectors 
(, y)k , we obtain 


(39) 

or, more explicitly, 




P(« I m; j) = X) A***" y* , 

*-o 


(40) 


/ P \ n 2 / Q \ m/2 

P(n|m;j) = io(2 V / Mcosh0 o ) I f—j ( — V F m {6 a )F.{8t) [l + (- 1) ■»+»+•] 

\\ ^ Q / \ P / 


( PX 1 ' 2 / q \ ml2 _ 

T/ \T/* ^ C0S ' 0 */«(©*)/n(©*). 

Making use of (21), we can achieve considerable simplification by letting 
R —>°°. In fact, it can be shown that 


R~ 2 


(41) P(» m; 5 ) = 


- q 

2 pq 




+ (- 1 ) 


m+n+« 
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+ 


tan 2 © 


(p.y(±y\ 2xTq) . r cos . 0 ___ 

\q/ \pJ* Jo (p- qV+ tan 2 © 


/n(©)/m(©)^©. 


Although in various places we have tacitly assumed that p and q are different 
from J, the final formula (41) can easily be seen to be valid also for the case 
p = q = %. In this case (free particle in the presence of a reflecting barrier) the for¬ 
mula assumes the remarkably simple form 


. 2 r r 

(42) P{n | m; s) = — (l) m/2 I cos' © cos m© cos «0<f0, 

TT * J 0 


and the right member can be expressed in terms of binomial coefficients. This 
formula can also be derived in a much simpler way using, for instance, the classi¬ 
cal method of images. 

In the limit 

A 2 

A —> 0, T —* 0, - = D. mA —> To, ST = /, 

2t 


one can show that 


lim V* P(n | m\ s) = f P(x 0 | x; t)dx, 

z ,<mA< zj J z\ 

where 


(43) P(x 0 \ x\ t) = 4fie~ i0x + e -2 


-20 (z- xrfp- 


, 2 r 

40* D t _ 

7r J i 


00 




y 2 


4 (P + y 2 


g(x,y)g(x 0t y)dy. 


and 


g(x, y) = cos xy — 2/3(sin xy)/y. 


The proof of this theorem is not elementary inasmuch as it utilizes the so called 
“continuity theorem for Fourier-Stieltjes transforms” [6]. Formula (43) can be 
shown to be equivalent with Smoluchowski’s formula given in [l]. 

4. An elastically bound particle. Again the particle can move either A to the 
right or A to the left, and the duration of each step is r. However, the probability 
of moving in either direction depends on the position of the particle. More pre¬ 
cisely, if the particle is at &A the probabilities of moving right or left are 



respectively. R is a certain integer, and possible positions of the particle are 
limited by the condition — R^k ^R. The basic probabilities P{n\m\ s) now 
satisfy the difference equation 
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(44) P(n\ m; s+l)=±L m+ l p , n 

2 R 


P{n \ m + l- t s) + 


R — m + 1 
2R 


P(n \ m - 1; s), 


which must be solved with the initial condition 


(45) 

In the limit 


P(n \ m;0) = 8(m, n). 



St 




the difference equation (44) 
equation 


is seen to go over formally into the differential 



dP 

dt 



d(xP) 


dx 


- + D 


d 2 P 
dx 2 


which is Smoluchowski’s.equation (5) with F(x)=-xyf. 

The discrete problem in a different form and in a different connection was 
first proposed and discussed by P. and T. Ehrenfest in 1907 [7]. In the next 
section we shall discuss their original formulation. A fairly detailed treatment 
was given by Schrodinger and Kohlrausch in 1926 [8] and a brief exposition can 
be found in the review article of Wang and Uhlenbeck [l]. It seems that Schro¬ 
dinger and Kohlrausch were the first to point out the connection between the 
Ehrenfest model and Brownian motion of an elastically bound particle. How¬ 
ever, an explicit solution of (44) with the initial condition (45) was apparently 
not known. I have recently found such a solution using the matrix method de- 

scribed in Section 3 [9]. Instead of the infinite matrix of that section we must 
now consider the finite matrix 



and the problem is again reduced to finding the eigenvalues A_*, \_ R+1 , 
^o, • • • , A*_i, X R of B and matrices P and Q such that 


• • • 


9 
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(48) PQ = / 

and 




X-R+l 0 

0 i 




As before, P{n m ; 5 ) is the (m, n) element of B\ where 



In order to perform the diagonalization (49) explicitly we start (following the 
procedure of Section 3) by trying to find the eigenvalues and the right eigenvec¬ 
tors of B. For this purpose we consider the system of linear equations 




Xo -f- 



1 

2 R 
2 

2 R 
3 

2 R 





and the auxiliary infinite system 


1 

2 R 


X’LR —1 — X*2 R, 




Xq + 



1 

~2R 

2 

2R 
3 

2^ 
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1 

2 R 


2 R + 1 
2 R 

2R + 2 
2 R 


XlR+l ~ X^2 R 


— X# 2 /?+l 


If we can find non-trivial solutions of (52) for which 
(53) *27?+l = 0 


we will have found solutions of (51). It will turn out that this procedure will 
again yield all eigenvalues and right eigenvectors. Multiplying the members of 
the equations of (52) by 1, z, z 2 , • • • , and adding, we obtain formally 



or, introducing the abbreviation 


/(z) = x k z k , 


*«= o 


Z/(Z) ” lR nZ) + i /,(2) = X/(2) ' 

We thus get the differential equation 

(54) f'(z) = 2*-J— -f(z), 

1 — JZ 2 

whose solution satisfying/(0) =Xo is easily found to be 

(55) f(z ) = or 0 (l - 2)^ (1 - X) (1 + 2)«< 1 + X >. 

Since f(z) is analytic in the neighborhood of z = 0 the formal procedure can be 
justified. 

We now notice that if 


(56) X = —. j = - R, - R 4- 1, • • • , 0, ■ • • , R - 1, R, 

R 

f(z) is a polynomial of degree 2 R, and hence X2R+i=0. The numbers (56) are 
thus seen to be eigenvalues of B and, since there are 2R + 1 of them, we see that 
we have found all the eigenvalues. It also follows that the components of the 
right eigenvector belonging to the eigenvalue \j=j/R can be taken as 




• • 
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where the C *s are defined by the identity 


(57) 


(\ _i_ \ R+i + 7) k 

(1—2) (l+z) = 2^ C* z 

0 


So far we have followed very closely the procedure described in Section 3. Sur¬ 
prisingly enough, we encounter unexpected difficulties in trying to carry out 
the analogy still further and determine by similar means the left eigenvectors. 

To find the matrix Q we resort to a different method. Let us first recall that 
P can be taken as the matrix whose 7 th column (for convenience columns and 
rows are numbered from — R to R) is 


C 1 

d” 


(;) 

t-2/« • 


Matrix Q must satisfy the equation 


RQ = /, 

which is an immediate consequence of the equation PQ = I t and hence denoting 
by a _ Rt ■ • • 

> «o, • • • , cxr, the consecutive elements of the 7 th column of Q\ we 

must have 


(58) 


From (58) it follows that 


E CR+rCCk = 5(/, r), 


r = ~ R, 


k—R 


, R 


* +i _ t/ ■ r \„ R+r _ V R+r V'' r ( ' k) V""' „(*) R+r 

2 2^ r ) z — E z E Cn +r ak = E E Cr+tZ 

- R r» ft *—A -A --/? 


= e e erv, 

*- R a—0 


or, by virtue of ( 57 ), 


- E «*(1 

A:-A 


- z)*-*(l + z)*+* = (1 - Z) 


s-G—O' 


Thus 


(59) 


A+J 


(1 - 2 ) 
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Let 




so that 


i - r 

z --and 1 — 2 

i +r 


i + r 


In terms of f (59) assumes the form 


(60) 


and since by (57) 


1 )*+* 


(i - f) s+ 'd + f)*-'- = £ 


/-0 


(i - f) n+ ’d + = z c,‘-V. 

1-0 

we obtain, by comparing coefficients of corresponding powers of f, 

(- 1)*+'^—/) 

= 2 2 * C ‘ * 


or finally, 
(61) 


“• = — u c «+* 


Formula (61) determines explicitly the elements of Q' (and hence of Q ), and it is 
now possible to write an explicit expression for P(n\m; s). In fact, making use 
of (50), we obtain 


(62) 


In the limit 


P(n I m; s) = 


(- 1 ) 


/?+» R 


2 2R 


m 


( -n) (;) 


A 2 1 

A _ 0> T _o, - = A —■-r 


sr = t, wA —> * 0 , 


we have 


lim 23 P(»|w;s) = r P(xo\x; t)dx, 

i,<mA< *j ^ zi 


where 


i>(*o *; t) = . . - - e -7(^-«..-i’')*/Sr«-.- a ”') 

1 \/2irZ)(l - e-‘r<) 


(63) 


*»> 


t 


3 1 

> 
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The proof is again made to depend on the continuity theorm for Fourier-Stieltjes 
transforms. 

The frequency function (63) was first discovered by Lord Rayleigh [lO]. Its 
connection with Brownian motion of an elastically bound particle, in the strongly 
overdamped case, was established by Smoluchowski who arrived at it quite 
independently. 

5. The Ehrenfest model. Irreversibility and recurrence. Imagine 2R balls 
numbered consecutively from 1 to 2R, distributed in two boxes (I and II) so 
that at the beginning there are R-\-n, — R^n^R, balls in box I. We chose at 
random an integer between 1 and 2R (all these integers are assumed to be equi- 
probable) and move the ball, whose number has been drawn from the box in 
which it is, to the other box. This process is then repeated s times and we ask 
for the probability Q{R-\-n | R-\~m ; s) that after 5 drawings there should be 
R-\-m balls in box I. 

* A moment’s reflection will persuade one that this formulation (originally 

proposed by P. and T. Ehrenfest) [7] is equivalent to the random walk formu¬ 
lation of Section 4, if one interprets the excess over R of balls in box 1 as the dis¬ 
placement of the particle (A = 1). Thus 

Q(R -f- n | R T- m\ ) = P{ti | m \ s), 

where Pin | m; s) has the meaning of Section 4. 

In the present formulation we have a simple and convenient model of heat 
exchange between two isolated bodies of unequal temperatures. The tempera¬ 
tures are symbolized by the numbers of balls in the boxes and the heat exchange 
is not an orderly process, as in classical thermodynamics, but a random one like 
in the kinetic theory of matter. The realistic value of the model is greatly en¬ 
hanced by the fact that the average excess over R of the number of balls in box 
I, namely, the quantity 

R 

E mP(n | m ; s) 

m ——R 

can easily be shown to be equal to 

which in the limit R-* co, \/Rt — > 7 , sr = t, gives 

ne~' , \ 

or the Newton law of cooling. 

There are several proofs of (64) [ll]. The most straightforward one, which 
is not however the simplest, is based on formula (62). 

The Ehrenfest model is also particularly suited for the discussion of a famous 
paradox which at the turn of this century nearly wrecked Boltzmann’s inspired 

1 
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efforts to explain thermodynamics on the basis of kinetic theory. In classical 
thermodynamics the process of heat exchange of two isolated bodies of unequal 
temperatures is irreversible. On the other hand, if the bodies are treated as a 
dynamical system the famed “Wiederkehrsatz” of Poincar6 asserts that “almost 
e\er\ state (except for a set of states which, when interpreted as points in 
phase space, form a set of Lebesgue measure 0) of the system will be, to an arbi¬ 
trarily prescribed degree of accuracy, again approximately achieved. Thus, 
argued Zermelo, the irreversibility postulated in thermodynamics and the “re¬ 
currence” properties of dynamical systems are irreconcilable. Boltzmann then 
replied that the “Poincare cycles” (time intervals after which states “nearly 
rccur f° r the first time, the word “nearly” requiring further specification) are 
so long compared to time intervals involved in ordinary experiences that pre¬ 
dictions based on classical thermodynamics can be fully trusted. This explana¬ 
tion, though correct in principle, was set forth in a manner which was not quite 
convincing and the controversy raged on. It was mainly through the efforts of 
Ehrenfest and Smoluchowski that the situation became completely clarified, 
and the irreversibility interpreted in a proper statistical manner. 

It will now be easy to discuss this explanation by appealing to the Ehrenfest 
model. Let P'(n\m\ s) denote the probability that after 5 drawings (the dura¬ 
tion of each drawing is r) R-\-m balls will be observed for the first time in box I 
if there were R-\-n balls in that box at the beginning. In particular, P'{n\n;s) is 
the probability that the recurrence time of the state “n” (defined by the presence 
of R + n balls in box I) is st. One can then show that 

(65) tp'(«|«;s) = 1, 

«=i 


or, in other words: each state is hound to recur with probability 1. This is the statis¬ 
tical analogue of the “Wiederkehrsatz.” One can show furthermore that the 
mean recurrence time, namely, the quantity 


is equal to 
( 66 ) 


0 n = S srP'(n | n \ s) 

5 ™ 1 


(*+ «.)!(*- »)! ,,. 

(2 R)\ 


This is the statistical analogue of a “Poincar6 cycle,” and it tells us, roughly 
speaking, how long, on the average, one will have to wait for the state “w” to 
recur. 

If R + n and R — n differ considerably, 6 n is enormous. For example, if 
R = 10000, n = 10000, r = 1 second, we get 

0 = 2 20000 seconds (of the order of lO 6000 years!). 
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If on the other hand, R-\-ti and R — n are nearly equal, 6 n is quite short. If in the 
above example we set tt =0 we get (using Stirling’s formula) 

0 ~ 1 ()0\ > seconds —' 175 seconds. 

It was Smoluchowski who advanced the rule [ 12 ] that if one starts in a state 
with a long recurrence time the process will appear as irreversible. In our ex¬ 
ample if one starts with 20000 balls in one box and none in the other, one should 
observe, for a long time, an essentially irreversible How of balls. On the other 
hand, if the mean recurrence time is short, there is no sense to speak about ir- 
reversibilitv. 

We now give the proofs of (65) and (66). We shall base our considerations 
on a formula which Professor Uhlenbeck used for similar purposes in some of his 
unpublished notes. The formula in question is: 


(67) 


P(n | m \ s) = P'(n | m \ s) -f X P\n | m ; k)P(?n j m\ s — k). 


Io convince oneself of the validity of this formula we divide all possible ways 
of reaching “m” from u n” in 5 steps into classes according to when “m” has been 
reached for the first time. We then observe that starting from u n” one can reach 
“m v in 5 steps in the following s mutually exclusive ways: 

(1) ‘'m n is reached for the first time after 5 steps. 

(2) u m* is reached for the first time in 1 step and then, starting from “m n it is 
again reached in 5 —1 steps. 

(3) “w” is reached for the first time in 2 steps and then, starting from “m”, 
it is reached again in s — 2 steps, and so forth. We note furthermore that 
the probability that u m r> will be reached for the first time in k steps 
and then, starting from u m,” it will be reached again in s — k steps, is 

(68) P\n | m\ k)P(m | m \ s — k ). 

This completes the proof of (67). 

It should be emphasized that the justification of using the product of prob¬ 
abilities in (68) rests upon the fact that in our process the past is independent of 
the future. In other words, once we know that the system starts, say, from “m,” 

its subsequent behavior is independent of the way in which u m” was reached in 
the first place. 

We introduce now the generating functions 


(69) 


(70) 


co 


h{n | m\ z) = ^2 s)z a 


00 


g(n | m; z) = X) P\n m; s)z', 


J-l 


and note that (67) is equivalent to 


h(n | m; z) = g(n | m; z) + h(m | m\ z)g(n \ m\ z), 
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g(n\m;z) = 


h(n | m; z) 


1 -f h(m m; z) 


In particular, 
(72) 


( , h(n\n\z) 

g(n | n;z) = — . , — = 1 


1 h(n I ti; z) 


1 + h(n | n; z) 


and we also note that 


dh{n | n \ z) 


dg(ti \ n; z) 
dz 


dz 


(73) 

(1 -j- h{n | n; z)) 2 
From the definition of g(n\n; z ), we obtain 


(74) 


00 


lim g(n | n ; z) = R'( n I n] s ) 

t —»1 


(75) 


8-1 

00 


dg(n n;z) 

r lun--- = X STP\n n; s). 

i dz 


«-i 


It is from these formulas that we shall derive (65) and (66). We have, using (62) 

(_ l)rt+n R 


h(n \ n; z) = 


2 2R 


;—R »-i \K / 


and since 


1 = 


e_ D*+« r , , 


we obtain 


(76) 


1 -f h(n | n\z) = 


(- D* +n f, 

2 2fi ^ 


^— c«7,- c*+„ 


7-* 


1 - 


R 


All terms in the sum on the right hand side of (76) are regular at z = 1 except the 

term corresponding to j = R, which has a simple pole at that point. Thus we can 
write 

1 4- h(n | n\ z) = p(z) 4-—“- C 2 R Cr+ u - , 

1 — z 

where p(z) is regular at z = 1. We see that 

lim (1 + h{n | n\ z)) = 


00 


3 1 
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and hence, using (72) and (74) 


cc 


Z-P'(»| «*;:*) = 1 . 


J-l 


It is easy to see that 


Cli + n 


i 


( 22 ?)! 


7 lli (R + >/)!(A - n)\ 


and, denoting this expression by co, we have (for |s| < 1) 

dg(n | n\ z) _ (1 — z)-p'{z) + a; 

dz j(l — z)p(z) -f ^] 2 


and hence 


dg(n\n\z) 
lim- 


1 


* — 1 


dz 


co 


This together with (75) yields (66). 

The above considerations can be extended to more general processes. How¬ 
ever, Markoffian processes (i.e., processes for which (68) is valid) are still the 
only ones for which one can also calculate the “fluctuation” of the recurrence 
time, namely, the quantity 


(77) 


oo 


2 2 


2 5 T I n » s ) — 


• «1 


W ithout going into the details, let us mention that (77) can be calculated in 
terms of 


lim 

2—1 


d 2 g(n | «; z) 
dz 2 


The fluctuation (77) gives us a measure of stability of the mean recurrence time 
inasmuch as it permits us to estimate how likely (or unlikely) it is to get a spec¬ 
ified deviation of the actual recurrence time from the mean. It may seem that 
since the generating function g(n\n; z) is known explictly it should be easy to 
get an explicit expression for P'(n \ n; 5). This, however, is not the case. We have 
not succeeded in finding such an expression, except for P'(0| 0; 5), and even then 

ue had to use a different method. We shall give a brief description of this 
method. Let 


P(n | m; 1 ) = p nm . 


Then, 


P ( n J tl\ S ) PnmiP mjmj * * Pm,- X ni 


n%i 9 • • • ,m f -j 
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where the 
Now let 
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accent on the summation sign indicates that m f 9 ^n t j 2, • • •,5 — 1 


€. = 



Noticing that 


2 


= «t, 


we can write 


P'(n\n\s)= £ 


771 2 m J 


m 11 • • • .m f _| 


if i = n 
if i 9^ n. 


m 




x n, 


where the summation is now extended over all m,. If B is the matrix 


and B\ the matrix 


( (.Pn m) ) , 


((fn^nmfn))i 

we see that 

P\n | n \ s) = ( n, n) element of BB\ *B. 

W e may note that B\ is obtained from B by crossing out the nth row and the 

nth column of the latter, and replacing them by a row and column consisting 

entirely of zeros. If B\ can be explicitly diagonalized, that is, written in the 
form 


where 



PiQi = I 

one can calculate P'{n\n\ s), explicitly using (78). 

We have applied this method to the Ehrenfest model, but only in the case 
when the middle (zeroth) row and column of B are replaced by a row and col¬ 
umn consisting entirely of zeros have we been able to diagonalize explicitly the 
resulting matrix B\. The diagonalization proceeds very much as in Section 4, 
but it has proved necessary to distinguish between the cases when R is even or 
odd. In case R is even, we were able to derive the formula 


1 


R + 1 




•-2 


i, 


(79) 


P'(0|0;5) = - 


2 2R ~ l 2R 


s ^ 2 , 
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where the summation is extended over all odd integers j between — R and R. 
The details of the derivation are somewhat tedious and will not be reproduced 
here. Formula (79) furnishes a partial solution to a question left open by Wang 
and Uhlenbeck (l ]. 
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THE BROWNIAN MOVEMENT AND STOCHASTIC EQUATIONS 

By J. L. Doob 


'Received January 14, 1942) 

The irregular movements of small particles immersed in a liquid, caused by 
the impacts of the molecules of the liquid, were described by Brown in 1828. 1 2 
Since 1905 the Brownian movement has been treated statistically, on the basis 
of the fundamental work of Einstein and Smoluehowski. Let x(t) be the 
^-coordinate of a particle at time /. Einstein and Smoluehowski treated x(t) 
as a chance variable. They found the distribution of x{t) — x(0) to be Gaussian, 
with mean 0 and variance a t , where a is a positive constant which can lie 
calculated from the physical characteristics of the moving particles and the given 
liquid. More exactly, such a family of chance variables U'(7)l is now described 
as the family of chance variables determining a temporally homogeneous differ¬ 
ential stochastic process: the distribution of x(s -j- /) — x(t) is Gaussian, with 
mean 0, variance a | t |, and if /j < • • • < /„ , 

x{h) — x{U ), • •• , x(l„) — x(tn-i) 

are mutually independent chance variables. Wiener, who was the first to dis¬ 
cuss this stochastic process rigorously, proved in 1923 that the functions x(t) 
of this stochastic process are continuous, with probability 1/ This is of course 
a desirable result, which makes the stochastic process somewhat more acceptable 
as the mathematical idealization of the Brownian movement. It was not ex¬ 
pected, however, that the above distribution of x(s -f - t) — x(s) would prove 
correct for small t. Even if the derivation did not break down for small t, the 
mathematical fact that x(s + t) — x(s) has standard deviation a \ ( j so that 
x(s + 0 — x(s) is of the order of magnitude of \ t \\ implying that dx(s)/ds 
cannot be finite, would suggest the desirability of modifications of the Einstein- 
Smoluehowski distributions. In fact it is easily seen that (with probability 1) 
x(t) is not even of bounded variation, so that the path curves of the Einstein- 
Smoluchowski process have infinite length! 

A different stochastic process describing the x(t ) was in fact derived in 1930 
bv Ornstein and Uhlenbeck (15), 3 and later by S. Bernstein (1), (2) and Krutkow 
(11), all using different methods. This new distribution of x(s -f- i) — x(s) is 

1 I’or !t historical account of the subject up to 1913, see Haas-Lorentz (6). (The 
numbered references will refer to the bibliography at the end of the paper.) 

2 Wiener (18, pp. 148-151) has since given a more simple proof. For a discussion of the 
exact meaning of such a statement concerning the continuity of paths, cf. Doob (3) and (5), 
§2. The result means that x(t) can be treated as representing one of a multiplicity of 
continuous functions of t, and integrated, etc. Probability here is formally the study of 
measures on certain spaces of functions. 

3 Cf. also Ornstein and Wijk (16) and Wijk (17). References to work since 1913 are given 
in Ornstein and Uhlenbeck (15). 
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Gaussian, with mean 0 and variance (a/£)(<T* m - 1 + (3 | t |), approximately 

a I * I f° r ^ ar K e L but a(3l~/2 for small t. (Here (3 is a second physically deter¬ 
mined constant.) 

I he purpose of the present paper is to apply the methods and results of 
modern probability theory to the analysis of the Ornstein-Uhlenbeck distribu¬ 
tion, its properties and its derivation. It will be seen that the use of rigorous 

simplifies some of the formal work, besides clarifying the 
hypotheses. A stochastic differential equation will be introduced in a rigorous 
way to give a precise meaning to the Langevin differential equation for the 
velocity function dx(s)/ds. This will avoid the usual embarrassing situation in 
which the Langevin equation, involving the second derivative of x(s) is used to 
find a solution a:(s) not having a second derivative. 

1. The velocity distribution 

The displacement function x(t), as discussed by Ornstein and L T hlenbeck, has 
a derivative u(t), and all the probability relations needed can be derived from 
those of u(0, as " ill be seen below. The distribution of u(t) can be described 
as follows: the conditional distribution of u{s + t) (t > 0) for given u(s) = u 0 , 
is Gaussian, with mean v 0 e~ dl and variance cl(l — c~ 20( ). Here cl , 0 are 
physically determined constants. When t —► », this distribution becomes the 
Maxwell distribution of velocities, furnishing stationary absolute (uncondi¬ 
tioned) probabilities for the process, if these are desired. L T sing these absolute 
probabilities, which make the distribution easier to describe, the full description 
of the u(() distribution can then be stated as follows: for each t, u{t) is a chance 
variable with a Gaussian distribution, having mean 0, variance cl ; the transition 
probabilities are as just described; the process is a Markoff process. 4 This last 
fact means that the Maxwell distribution of u{t Q ) for each fixed to , and the 
transition probabilities just described determine the full set of probability rela¬ 
tions of the process. Under these conditions, if t\ < t 2 , the pair w(h), ?/(/«) has 
a bivariate Gaussian distribution, with zero means, equal variances cl , and 
correlation coefficient e ~ 0Ui ~ ,l \ This stochastic process goes back at least to 
Smoluehowski, although it was first derived by Ornstein and LTilenbeck as the 
process describing the velocity of a particle in Brownian motion. Ornstein and 
Uhlenbeck were only interested in the transition probabilities. The formal 
manipulations made below will show that there are technical advantages in 
defining (unconditioned) probabilities for the u{t) also. The above described 
process will be called the O. L r . process below. 

The following theorem shows that such a process is essentially determined by 
three fundamental properties, of which at least the first two have simple physical 

4 A process is called a Markoff process if whenever h < • • • < t„, the conditional distribu¬ 
tion of ?/(/„) for given values of u(h), •••, u(t n -\) actually depends only on It is 

in this case, and only in this case, that the Smoluehowski equation between the transition 
probabilities, and the Fokkcr-Planck differential equations for the transitional probabili- 
tiesare valid. 
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significance. (We can exclude Case A of the theorem, since it obviously does 
not fit the physical picture.) 

Theorem 1.1. Let u(t) ( — x < t < -fi 00 ) be a one-parameter family of chance 
variables, determining a stochastic process with the following properties. 

1. The process is temporally homogeneous . s 

2. The process is a Markoff process. 

3. If s, t are arbitrary distinct numbers , «/($), u(l) have a ( non-singular ) bivariate 
Gaussian distribution. 

Define m, (To by 


( 1 . 1 . 1 ) 


m = E\u(t)\, (To = £{[u(0 — mf j. 


Then the given process is one of the following two types. 

(A) // /1 < • • • < t n , u(t\), • • • , u(t n ) are mutually independent Gaussian 
chance variables, with mean rn and variance al . 

(B) (O. U. process) I'here is a constant 0 > 0 such that if /, < • • • < t n , 
u(/i), • • • , u(t r .) have an n-variate Gaussian distribution, with common mean m 
and variance a () , and correlation coefficients determined by the equation 
E\[u(t) — m][u(.s) — rw|| = 

Instead of considering u(t), we can consider (l/<ro)[u(0 — m], which has 
mean 0 and variance 1. Then we shall assume in the following that u(t) itself 
has these properties: m = 0, al = 1. Let p(0 be the correlation function: 
p(0 = E\u(s + t)u(s)\, independent of s by Property 1. If s < t, the condi¬ 
tional distribution of u(t) for given u(s) has density 


( 1 . 1 . 2 ) 


1 p« :n ( 1 luU)-pu(s)] 

(2tt)1(1 — P 2 )* P V 2 


P = pit — s ), 


(Property 3). If t x < • • • < t n , u(fi), • • • , u(t n ) then have an /7-variate Gaus¬ 
sian distribution with densitv 


n n — 1 


(1.1.3) (2jr) 2 XI (1 — P/)* 




Pi = p(tj + 1 — tj), u, = u(tj) 

using Property 2. Now if U\ , • • • , u n have an n-variate Gaussian distribution 
with density 


(1.1.4) 


! exp (~ £ 2 : <*#«*«#), 


A = det(/S{M,-Hy)) is the determinant of the matrix of variances and covariances, 

and (a*,) is the inverse of this matrix. Using these facts we can calculate 

p(h - ti) = E[u x u z ) in (1.1.3) with n = 3, and find that p(< 3 — h) = PlP3 , 
that is 


6 That is, the probability distributions are unaffected by translations of the *-axis. 
6 The expectation of the chance variable v will be denoted by E (y|. 
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(1.1.5) 


P [ h t\) — pipi — h)p(t 3 — to). 


I hen pit) is an even function; | p(t) j ^ 1 (Schwarz’s inequality); and according 
to (1.1.5) pus + 0 — p(«)p( 0 for Jih positive s, t. Under these conditions either 
p(t) = 0 or there is a constant 0 ^ 0 such that 


( 1 . 1 . 6 ) 


p (0 = C 




In the present case, d > 0 , by Property 3 (non-singularity of the given bivariate 
distributions). Evidently pit) = 0 furnishes Case A of the theorem, which 
certainly has the three given properties. If p(t) is given by (1.1.6) with (3 > 0, 
we show first that the matrix (a,,), the inverse of (p{tj — l t )) actually determines 
a Gaussian density distribution (1.1.4). To see this we consider the density 
function (1.1.3) with pj = The coefficients of the quadratic form 

in the exponent of (1.1.3) are easily evaluated and the matrix of the form is 
found to be the inverse of the matrix (e~ ^,|<; ~ <, ). Thus (1.1.3) actually is the 
required probability density. Moreover the probability densities obtained in 
this way (as the b vary) are mutually consistent, because integrating out any 
variable leaves a quadratic form of the same type, without the integrated 
variable, but with the same rule determining the coefficients. The correlation 
function (1.1.6) therefore determines a stochastic process. The process ob¬ 
viously is a Markoff process because of the form of the probability density (1.1.3): 
an initial factor involving u\ only, followed by the product of functions of pairs 
of adjacent variables. The proof of the theorem is now complete. 

According to a theorem of Khintchine ((9) p. 608), p(t) is the correlation func¬ 
tion of a temporally homogeneous stochastic process if and only if it can be put 
in the form 


(1.1.7) 



cos \t dF(\), 


where F(\) is monotone non-decreasing and bounded. 
(1.1.7) is true when F(\) is given by 


( 1 . 1 . 8 ) 



2/3<ro f X d\ 
t r Jo ( 3 2 + A 2 * 


In Case B of the theorem, 


In the stochastic process of Case B, the variance of w(s + t) — u(s) is 
2 < 7 o /3 | t | for small t: 

(1.1.9) E{[u(s + 0 - u(s)] 2 ) = 2 (To(1 - e~ 0lt ') ~ 2^/3 | t |. 

Thus «(s + /) — w(s) is of the order of magnitude of | ^ | § , and du/dt cannot 
exist. Physically this means that the particles in question do not have a finite 
acceleration (if the given stochastic process represents the Brownian movement 
that closely). 

Theorem 1.2. If u(t) is the representative function of the stochastic process of 
Theorem 1.1 Case B, u{t) is a continuous function of t , with probability 1. 
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Let v(t) be determined by the equation 


( 1 - 2 . 1 ) 


v(t) = **uQ^log 


t > 0 


Then v(t) has the property that if < • • • < t n , v(t\), • • • , t>(/„) have an 
n-variate Gaussian distribution. We find by direct calculation (taking m = 0): 


( 1 . 2 . 2 ) 


E\v(s + t) — v(s) j = 0, 

/T {[t’( s* -TO — <-(«)] 2 | = alt, 

E\[v($t) — v(si))[v(t 2 ) - r(/i))| = 0, (si < s 2 ^ t\ < t 2 ). 

Then v(t) determines a differential process—in fact precisely the original Einstein- 
Smoluchowski process. Since Wiener has proved continuity of the path func¬ 
tions in this case, the theorem follows. 

The transition from u(t) to v(() just used reduces every property of the 
Ornstein-Uhlenbeek stochastic process to a corresponding property of the 
Einstein-Smoluchowski process, and vice versa. Many properties of the indi¬ 
vidual functions of the latter process, that is, properties possessed by almost all 
the individual functions, in other words possessed “with probability 1,” have 
been proved in recent years, besides the continuity property we have just used. 
The following theorem gives the counterparts of two of these for the O. U. 
process. 

Theorem 1.3. If u(t) is the representative function of the O. U. process of 
Theorem 1.1 Case B, 


(1.3.1) lim sup 


u(t) — u(Q) 


11 ouu 0 

< - # (4oiW log log (I/O) 1 


= 1, 


lim sup -—-, = 1 

1 -*0 (2<7o log 0 


with probability 1. 

Let v(t) be defined by (1.2.1). Then Khintehine ((10) pp. 68-75) has proved 


= 1 , 


r i’(0 — t’(0) 

lim sup-^- — _ = i 

(2<r 0 1 log log 0* 


(1.3.2) lim sup -* 1 + 0 ~ »(D 

1 “*0 (2(To/ log log (1/0) 

and (1.3.2) becomes (1.3.1) when t ft) is expressed in terms of u{t). 

2. The distribution of displacements 

It does not seem to have been realized by earlier writers that the distribution 
of displacements in the O. U. process can be obtained directly from that of the 
velocities. In fact, we have seen that as t varies, u{t) considered as one of a 
multiplicity of continuous functions of t. Integration of u(t ) is therefore ad¬ 
missible, and will give the displacement function. If x{t) is the x-coordinate 
of a particle at time t, 


x(t) — x(0) = J u(s) ds 


(2.1) 




356 


J. L. DOOB 


324 


wit 1 probability 1 (that is, neglecting the discontinuous u{t) functions which 

have total probability 0). The main advantages of the rigorous approach to 

stochastic processes depending on a continuous parameter is precisely that the 

v(0 of the process, as t varies, can be regarded as an individual function or 

rather, as one of many functions with whatever regularity properties the given 

probability distributions imply. Theorem 1.3 limits the actual upper bounds 

of the velocity functions u(1). The following result takes advantage of the 
oscillations in sign. 

Theorem 2.1. If u{t) is the representative function of the O. U. process of 
Theorem 1.1 Case B, with m = 0, 

(2-1.1) lim i [‘ «(,) * = Jim x(<) ~ x(0) = 0 

* — 30 * *'0 t-*oo t ' 

with probability 1. 

1 his theorem is simply the ergodic theorem applied to the u(t) process to give 
the strong law of large numbers, (cf. Doob (4) p. 294). From (2.2.3) below, it 
is quite obvious that the expectation of the square of the left side of (2.1.1) 
goes to 0 as t > ^, so that the left side goes to 0 in the mean. The strength of 
(2.1.1) is that it is a statement about the path of the individual path functions, 
or physically, a statement about the path of a single particle. The same was 
true in Theorems 1.2 and 1.3. 

In order to find the distribution of x(t) - x(0) we proceed as follows. Rie- 
mann integrability of u(t ) implies that (with probability 1) 

(2- 2 - 1 ) x{t) - x(0) = lim £ u(tj/n)t/n. 

n -♦CO ; — 1 

Now the n-variate distribution of the variables summed is Gaussian. Then the 
sum is Gaussian, so the distribution of x(t) - x(0) is also Gaussian, if it can be 
shown that the variance of x(t) - x(0) is positive. The distribution of 
x(t) - .r(0) is thus completely determined by its first two moments, which we 
proceed to calculate. We shall suppose, that E\u(t)\ = 0, E{u{t) 2 ) = <j\ . 
Then we find 

(2.2.2) E\x(t) - x(0)j = [‘ E{u(.s)} ds = 0,' 

Jo 

and, if t > 0, 

E{[x(t) — a:(0)] 2 j = f [ E{u(s)u(s' )} ds ds' 

(2 - 23) ° ° 

= al !‘ ( e-^-'dsd S '= 2 j}(e^-,+0t). 

7 By Fubini’s integration theorem, we can find the expectations under the integral sign, 
before integrating with respect to s. 
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The same sort of argument shows that if t\ , • • * , t n are any distinct numbers, 
the chance variables 


\x(tj) - x(0), u(tj), j = 1, • • • , n\ 

have a 2/i-variate Gaussian distribution, which can then be evaluated explicitly 
by finding the first and second moments. For'example, the following equations 
determine the bivariate distribution of x(t) — x(0), u(t), (t > 0): 


E{[x(t) - -r(O)MO) 



/?{u(f)u($)| ds = 



(2.2.4) 


E\x{t) - x(0) j = 0, 


E\[x(t) — x(0)] 2 } 



- 1 + &t) f 


£’{u(/)|=0, E{u(t?\ = a\. 


Thus the bivariate density of x(t) — 
mean 0, and variances (2al/0~)(e — 1 
coefficient 


x(0), u(t) is Gaussian, with common 
-h l3t ), (To , respectively, and correlation 


(2.2.5) 


2*'(e-«- 1+00*’ 


It is to be expected that if s x < s 2 ^ h < t* , x(s 2 ) — x(«i) and x(t») — x(t x ) 
become independent as —» -x . In fact, these two normally distributed vari¬ 
ables have correlation coefficient. 


( 2 . 2 . 6 ) 


{e s, ‘ - e 0si )(e~ 011 - e ~ d,J ) 


_ i +0( S2 - Sl ))* T+ _ ,,))» ’ 


which goes to 0 when t x and to become infinite. 

If in this discussion only the conditional distribution functions are wanted, 
for m(0) = m 0 , for example, two procedures are possible. Setting u(0) = m 0 
instead of using the initial distribution we have used above, earning out the 
same type calculations as above, now would give the desired conditional proba¬ 
bilities. Or the conditional distributions could be calculated from tjie distribu¬ 
tions just derived, since the conditional distributions of a multivariate Gaussian 
distribution are easily found. Theorems 1.2, 1.3 and 2.1 hold no matter what 
initial distribution is assigned to u(0). 

I ( inally, there is one more fact which we shall need in the next section. Define 
B{t) by 

( 2 - 2 - 7 ) B(t) = 0lx(t) — x(0)] 4- u(t) — u(0). 

4 hen B{t ) has for each t a Gaussian distribution, with mean 0. Evidently the 
distribution of B(s 4- t) — B(s) is independent of s. It is Gaussian, with 
mean 0, and the variance is easily calculated to be 2al(3 \ l |. Moreover if 

Si < s 2 ^ U < tt . 
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( 2 - 2 - 8 ) E{[B(M) - B(t l )][B(s 2 ) - B( Sl )]} = 0 . 

Thus the £(0-process is again the Einstein-Smoluchowski process. 

3. Derivation of the velocity distribution using the Langevin equation 

Ornstein and Uhlenbeck base their investigation on the Langevin equation 

(3T) ^ = ~0u(t) + .4(0, 

wliich is simply Newton’s law of motion applied to a particle, after dividing 
through by the mass. The first term on the right is due to the frictional re¬ 
sistance or its analogue, which is supposed proportional to the velocity. The 
second term represents the random forces (molecular impacts). Probability 
hypotheses are imposed on the .4(0, including relations between A(t) and u(t), 
to determine the u(1) distribution. Unfortunately this u(t) distribution (Case B 
of Theorem 1.1), as we have seen, has the property that the velocity function 
has no time derivative. Then the solution can hardly satisfy r (3.1). 

Bernstein ((2) p. 361) replaces (3.1) by a finite difference equation: 

(3.2) A ~ ~ 0A£ n -f- n — 1, 2, •••. 

Here fc, £> , • • • is a sequence of chance variables, A£„ = £ n+1 — £„ etc., and 
<*i , a 2 , • • * is a given sequence of mutually' independent chance variables. If 
we think of as the analogue of x(jAt), the correspondence between (3.2) and 
(3.1) is clear. The equations of (3.2) determine definite distributions for the 
£/ in terms of those of the a;. Bernstein shows that as At —> 0 the distribution 
of A £„/At (~ Ax/At) becomes the u{t) distribution we have been discussing, if 
suitable hypotheses are made on the aj . This approach is essentially different 
from that of Ornstein and Uhlenbeck in that Bernstein, as he states explicitly 
((1) pp. 5, 6) is not writing a difference equation in the displacement functions 
x(t) themselves: (3.2) determines distributions only, and these are approximated 
by the limiting distributions described in Theorem 1.1 Case B. 

In our treatment, we shall replace the Langevin equation by a formalized 
differential equation for the velocity' function u(t). • This equation is to be 
exact, not merely asymptoticallj* true. The equation will be perfectly proper 
mathematically, so that solution by ordinary methods will provide all the infor¬ 
mation relevant to the desired distributions, and solution of more general prob¬ 
lems, involving external forces, will require no special methods. 

The problem is to find a proper stochastic analogue of the Langevin equation, 
remembering that we do not expect u'(t) to exist. We write the equation in 
the following form: 

(3.3) du(t) = —(3u(t) dt + dB(t), 

and try to give these differentials a suitable interpretation. We shall suppose 
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that the £(f)-process is a differential process: that is, if C < < t n , \se 

suppose that 

Bit,) - £(/,), ••• , B(t n ) - B(t n -i) 

are mutually independent chance variables. We also suppose temporal homo¬ 
geneity, that is that the distribution of Bis + /) - Bis ) is independent of s. 
The physical meaning of these hypotheses is clear, and they will be justified 
further below. Equation (3.3) can be interpreted roughly in terms of small 
changes in momentum. An important particular case is that in which the 
second moments of the process are finite: 


(3.4) 


(0 = B\\Bis + /) - £i's)f| < 


If this first moment 


The first moment E\ Bis + () - B(s )} then exists. 

\anishes, a'it) satisfies the functional equation 

a~(s -f- t) = <y~(s ) -b rr'it). 

Then a 2 (t) must be proportional to t: <?'</) = tc'. Il fit) is continuous, 


(3.5) 


I' m dim 


has been defined under these hypotheses (Wiener < 18), pp. 151-157, Doob (3), 
pp. 131-134), even though the functions Bd) are known not to be of bounded 
variation. The definition makes all the formal processes correct . For example, 
if /'(/) exists and is continuous, 


(3.6) [ fit) dB(t) = f(t)[B(t) - £(0)1 f - [ [B(t) - B(0))fV) 

J a 'a •'.i 


di 


with probability 1. The usual Riemann-Stieltjes sums converge to (3.5) in the 
mean. Moreover 


(3.7) 


e{ r ad dB(o ]= o, 

[Ja J 

E {[£ m [ f ff(0 dB(o] ' = « f fiOg(t) dt. 


Now it can be shown even without the hypothesis of the finiteness of the second 
moment in (3.4) that the formal integral in (3.5) can be defined, and will satisfy 
(3.G). The form of the characteristic function of B{s + t) — B(s) has been 
derived by L6vy ((14) Chapter VII) and using this it is easy to prove that the 


8 We never write Bit) alone in an equation, since strictly speaking only differences like 
B(t) — B{ 0) are defined. It is unnecessary to define B( 0) itself, although for convenience 
it can be taken identically 0, without affecting any of the equations to be used. Differential 
processes have been discussed in detail by L6vy ((12), (13), (14) Chapter VII) and Doob 
((3) §3). 
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u ual Ricmann-htieltjes sums for the integral (3.5) converge in probability. 
The integral is defined as the limit, and (3.6) is readily verified. On the other 

nn'-R r ,nn r be u expected t0 hold ' since if = 1 the integral becomes 
7 . h ’ ancl we have not supposed that the expectation of this difference 

lh Ihe spccial case in which the second moment is finite is the onlv 

important one for the purposes of this section, but less restrictive conditions will 

)e needed in §o. We shall justify later the assumption that the B(t) process 
is a differential process. 

We shall interpret an equation in differentials like (3.3) to mean the truth 
'With probability 1, that is for almost all functions u{t)) of 


(3.8) 


l f(t)dud) = -0 l fU)u(l) dl + J 


for a11 a > h > whenever / is a continuous function. Here the first two integrals 
are to be defined as the limits (in probability) of the usual Riemann or Riemann- 
otieltjes sums. Equation (2.2.7) implies 

/ fit) du(t) = - 0 [ /(0 dx(t) + [ fit ) dB{t) 

(3.9) ° “ 

= - 0 f fUMl) dt+ f f(t) dB(t). 

J a 

Thus (3.3) holds for the u(t ) of the O. U. distribution if the Bit) is defined by 
(2.2./). Moreover (2.2.7) with B(l) replaced by B(t) - B( 0) is an immediate 
consequence of (3.3). In this case, B(t) has the property that the differences 

7?(« + 0 - B(s) have finite second moments and even Gaussian distributions, 
but we are not making either assumption in solving (3.3). 

If (3.3) is true, then (with probability 1) 


(3.10) 


[ eP T du{r) = -0 [ 

JO J(\ 


3r 


L 


which implies, since integration by parts is applicable, 


(3.H) u(t) = uWc -* 1 + e~ 0t f c^dB{r) 

Jo 

for all t, with probability 1. Conversely suppose that u(t) is defined by (3.11). 
8ince B{t) is known to be continuous in t except for non-oscillator}' discon¬ 
tinuities (jumps) (Uvy (12) pp. 359-364, (13); Doob (3), pp. 134-138), the 
same must be true of the right side of (3.11), and therefore of u(t). Then u{t) 
is Riemann integrable with probability 1. Moreover 

(3.12) £ f(t) e- e ‘d, jf e^'dBir) = J fit) dBit), 


so that from (3.11) 
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</[/'«(*) - u(0)] = / fil)dB(t), 

J a 


proving incidentally that the left side exists. The left side can be simplified to 


(3.14) 


d I dt -f- f fit) du(t), 

J1 1 J a 


and putting this into (3.13) we find that (3.8) is satisfied. 1 hen (3.11) furnishes 
the complete solution of (3.3) under the stated conditions. We stress again 
that although <3.11) implies strong connections between the u(t) and Bit ) proc¬ 
esses, we have made no such hypothesis in tin* derivation not implicit in (3.3). 
L£vy ((11) pp. 1GG-1G7) has shown that the only differential processes whose 
path functions Bit) — B(0) do not have jumps have the property that the 
distribution of Bit) — B( 0) i> Gaussian. Then it is only in this ease, which will 
lead to the O. U. process, that u<t) will not have jumps. 

The term &u(t) in tin' I.angevin efiuation is supposed to account lor the total 
frictional effect, including the Doppler friction, caused by the fact that more 
impacts decelerate than accelerate the motion of a moving particle. The term 
/!(/) in (3.1) or (IBit) in (3.3) represents the “purely random” impulses, that is, 
the residual effect after the frictional effect has been subtracted out. One idea 
running through any treatment of the I.angevin equation is that this term or, 
sometimes, xit) itself, is independent of the given velocity at any time. This 
hypothesis goes back to I.angevin, and has caused much controversy. W e shall 
make the hypothesis onl\ to the following extent. The chance variable m( 0) 
will be given various initial distributions, but will always be made independent 
of the B(/)-process for t ^ 0. This means that if 0 ^ t\ < • • • < t„ the chance 
variable m( 0) is supposed independent of the set of chance variables 

\B(tj+ 1 ) — B(tj), j = 1, ••• ,n — 1). 


We shall describe the above hypothesis in the following physical terms: the 
initial velocity u( 0) is independent of later residual random impacts. It would 
be a serious drawback to the whole treatment if when u(0) is so chosen u(tf) 
for each t 0 > 0 were not independent of the B{t )~process for t ^ / 0 , that is if 
u(U)) were not independent of later residual random impacts for all . We 
can prove, however, the following statement, which incidentally justifies our 
hypothesis that the B(t)-proccss is a differential process. Let the B(t) process 
be a differential process, and define u(t) by (3.11). If the chance variable i/(0) is 
independent of the Bit)-process for t ^ 0, then u(t 0 ) will be independent of the 
B{t)-processfor t ^ t 0 ,/or all t 0 > 0. Conversely suppose only that the B{t)-process 
is regular enough that the integral (3.5) can be defined as the limit in probability 
of the usual sums, and that (3.6) is true. Then if u(t) is defined by (3.11), and 
if choosing a(0) independent of the B{t) process for t ^ 0 implies that u(t o) will be 
independent of the B(t)-process for t ^ U, , for all t 0 > 0, then the B(t)-process is a 
differential process. 
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1 ^ ^^" process be a differential process, define u{t) by (3 11 ) 

A? ? :;;r 1( ' per : dent ° the * w - prQcessf ° r *^ o. Then ll 3 n 

, : r 0 ’ “(/o) evolves only n(0) and the £(/)-process for / < / Tull 

w ^°) 1S independent of the £(/)-process for / > / k™,, D ~ ’ ^ ben 

differential one with Jiff • ", . — 0 becau se the -5(/)-process is a 

those involving/-values before^ , p° Ving ?' vaIues beyond .independent of 

pendent of the B<t)-p rocess forV > 0 / ei j Sely ^upposc that choosing w(0) inde- 

■i» *«)-pr.c» j , p a r La 0 >r^s;rr,r d ““ 


i 


and therefore 


/ 'o 

e 6 ’ <IB(t) 


the .‘ S(0 ' prOCess for * * * ■ Th ^ fact implies that the pre- 
integrlls determ ' nes a differential process, that is, if ft < ... < ft, the 


are mutually independent, 
intervals (t } -, t H i) 


/ 6 + i 

rf.B(r) 

/ 

Then (applying this fact to subintervals of the 


/ 


fy + i 


.-fir 


[ 


j — 1, • • • , n 


are mutually independent, and these repeated integrals are simply 


- B(tj) 


j = 1 


The latter differences are therefore mutually independent, as was to be proved 

We shall need the following lemma. 

em.ma 3. Suppose that a < 1, and let xo , Xi , • • • be mutually independent 
chance variables with a common distribution function. If there is a chance variable 
y with a Gaussian distribution such that the distribution function of a "-’x 
approaches that of y as n — <*>, then the x, have Gaussian distributions. 

J any of the hypotheses of the lemma are unnecessary, but its statement is 
general enough for our purposes, and the proof will apply to a situation to be 
discussed in §5, where the distribution of y will not be Gaussian. The hypothe- 
ses imply that the distribution of a’xj approaches that of d m ~ l y as n -> » 

2 l) ! s the characteristic function of x t and f(l) that of y, writing Vf a’x, 
in the form ax, + a’x j shows that 

Ht) = <p(at) -t(at). 

Solving for <p we find that it is the characteristic function of a Gaussian distribu¬ 
tion, as was to be proved. 
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In the physical picture under discussion, further conditions on the solution of 
(3.3) are known. In fact the Brownian movement is simply a visible example 
of molecular or near molecular movement . The general principles of such move¬ 
ments are therefore applicable, and the principle of equipartition of energy leads 
to the Maxwell distribution of velocities. Let k be the Boltzmann constant, 
and T the absolute temperature. We can formulate the significance of the 
Maxwell distribution (as much as we shall need it) as follows. 

Mi . 7 cadency towards the AI ax well distribution. W hatever the initial distri¬ 

bution of a(0), the transition probabilities have the propertv that when t —■* x 
the distribution function of u(t') converges to the Gaussian distribution function 
with mean 0 and variance I I m. (Here rn is the mass of the moving particle.) 

Mo. Stability of the Maxwell distribution. If ?/(0) hs independent of later 
icsidual random impacts, and it it has the Gaussian distribution described in 
Mi , w(0 will have this'same distribution for every positive t. 

I hese two statements are closely related, but neither apparently can be de¬ 
duced fiom the other without further assumptions. Since these principles act 
the pa it. of a dens ex tnachina in a discussion of the Langevin equation, we shall 

Use ^ iem as ^Mle as possible. It will usually be sufficient to use a weakened 
form of M, : 

Mi . There is an initial distribution of a(0), such that the transition proba¬ 
bilities have the property that when / — x the distribution function of u{t) 
converges to the Gaussian distribution function with mean 0 and variance kT/m. 

It is understood here as before that u(0) is to be independent of later residual 
random impacts. 

Conditions M, and M, restrict the possibilities for the #(0-process. In fact 
suppose that condition M[ is satisfied. Then (3.11) .shows that 


.-fit 


/> 


dB{r) 


is nearly Gaussian for large t, with mean 0 and variance kT/m. We write this 
integral as a sum, replacing t by nl: 


(3.15) 
where 

(3.16) 


—0nt 


J o o 


/ 


(>+iu 


.filr-jt) 


dB( r) 


ince the 5(0-proeess is a differential process, and is temporally homogeneous 
tlie x, are mutually independent, with identical distributions. According to 
e emma, the right side of (3.15) cannot become Gaussian for large t unless 

discuId on 1U * 1 °" 0f Xl is Gaussian - Thus, since t is arbitrary in the above 
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has a Gaussian distribution for all s, t. Since the chance variables 


(3.17) 



are mutually independent and Gaussian, the chance variable 


(3.18) 


£ 


0 



n 


*0"+l)J/n 

jt/n 


e* r dB{r) 



also has a Gaussian distribution. When n becomes infinite, (3.18) becomes 
B{() — Z?(0), with probability 1. The latter difference thus has a Gaussian 
distribution, with mean 0. The ^(0-process therefore has finite second mo¬ 
ments a 2 (t) = la ' as defined in (3.4). According to (3.7) the last term in (3.11), 
which we now know has a Gaussian distribution, has mean 0 and variance 
a (1 ~ e Then u(t) — e~ fit u( 0) has this same distribution. The vari¬ 

ance becomes <t'/2i3 when t —> « , and therefore, according to Mj , a 2 = 20kT/m. 
Thus condition Mi completely determines the Z?(/)-process. We show next that 
condition M 2 determines this same 2?(f)-process. In fact suppose condition M 2 
is true, and assign to a(0) the distribution of that condition. Then m( 0) is inde¬ 
pendent of the integral in (3.11), and in (3.M), u(t) (which has a Gaussian 
distribution, according to condition M 2 ) is expressed as the sum of two inde¬ 
pendent chance variables, of which the first is Gaussian. The characteristic 
function of the second is the quotient of the characteristic functions of two 
Gaussian distributions, and is therefore the characteristic function of a Gaussian 
distribution. Thus the expression 


(3.19) 



has a Gaussian distribution for all t, and this implies, as above, that B(t) — B{ 0) 
has a Gaussian distribution, with variance <r 2 t. The variances on the right side 
of (3.11) add up to that on the left, giving an equation for a 2 : 

(3.20) — = e~ 26 ‘— + ' e 

m m 2p 

Then a 2 = 23kT/m as above. 

We can now finally derive the O. U. velocity process as the solution of the 
Langevin equation. Suppose the i?(0-process is the one derived in the preceding 
paragraphs, and choose the chance variable w(0) to be independent of the 
Z?(0-process for t ^ 0. Then m(0) is independent of the integral in (3.11), and 
this means that the conditional distribution of u(t) for w(0) = no is Gaussian, 
with mean 0 and variance &!T(1 — e~ 2pt )/m. Moreover, (3.11) implies 

(3.21) u(s + t) = u(s)e~ 0 ‘ + f + e“’dB{r). 


As we have seen, u(s) is independent of the Z?(0-process as far as it appears 
in (3.21) and therefore is independent of the integral. Thus the transition 
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probabilities from s to $ + / are the same as those from 0 to t, which are pre¬ 
cisely those of the O. U. process. Incidentally it follows that the full condition 
Mi is satisfied. Finally, if m( 0) is not only supposed independent of the B(t)- 
process, for t ^ 0, but also is supposed to have a Gaussian distribution with 
mean 0 and variance kT m, the same will be true of u{t) (a< can be calculated 
lrom (3.11)) ami condition M 2 is thus satisfied. We can summarize all our 
results as follows. 

^Theorem 3. Let the B(t)-process he a temporally homogeneous differential 
process. Then (3.11 ) furnishes the solution of (3.3). The following conditions on 
the solution are equivalent. 

(i) The solution satisfies condition M[ . 

(ii) The solution satisfies condition M, . 

(iii) The solution satisfies condition M 2 . 

(iv) Bit) — B( 0) has a Gaussian, distribution , with mean 0 and variance 
of = t2f3kT/m. 

If the above conditions are satisfied , u(t) — e a< a(0) will have a Gaussian distri¬ 
bution with mean 0 and variance kT{\ - e~™ l )/m; if u{$) is independent of the 
B(t)-process for t ^ 0, u(s) is independent of the B(t)-process for t ^ s for all 
s > 0, and the transition probabilities of the u(t)-process are those of the 0. V. 
velocity process. If in addition u{ 0) has the Gaussian distribution with mean 0 

and variance kT/m , the uit)-process becomes the (). U. process, with m = 0, 
o 0 = kT/m. 

I he Langevin equation gives a physical interpretation to every property of 
the (). V. process. It is interesting to verify that as h -+ 0 the correlation 
coefficient of the pair Bis + h) - B(s), uU) (any s, t) goes to 0. In this sense 
then, dB(s), the effect of the residual random impacts at time s, is independent 
of the velocity at any particular time /. Since in (3.11) u(t) is written in terms 
of the # (7)-process, u(t) is of course not independent of this process. 

We haw* written u(t ) in terms of the B(t)~ process. It is easy to write x(t) 
in terms of the B{t) process by combining (2.1) with (3.11): 


(3.22) x (t) = x (o) + L. e .. U ( 0 ) + I [' [1 - >] 

Instead of finding the distributions of the displacement and velocity processes, 

and their correlations, as at the beginning of the paper, we could easily derive 

the desired results using (3.11) and (3.22). The various expectations can be 
calculated using (3.7). 

In physical applications, the correlation function E\ u(s)u{s + 0 ( is sometimes 
wanted as a time average. Now the transformation S h taking B{t) — £(0) into 

(t -f- h) _ preserves the B(t) probability relations (temporal homo¬ 

geneity), and the family of transformations {S h \ is well known to be metrically 
ransitive. Then applying the ergodic theorem to the function u(0)u(h) con¬ 
sidered as a function of the B(t ), we find that 


9 Cf. for example Doob, (3) p. 125. 
See Note on page 369 . 
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(3.23) lim - f u(s)u(s -f- h) ds = E{n(0)u(h)} = — e"^ ,A| 

i-*«c 1 J o m 

witli probability 1, that is for almost all functions u(t). The ergodic theorem 
was applied to the 5(*)-process in essentially this way by Wiener ((18) p. 169) 
who has been interested in the harmonic analysis of functions like the u(t) dis¬ 
cussed here. The work of this paper verifies in this particular case the impor¬ 
tance Wiener gave to the functions of the 5(0-process of the type (3.5). 

There is no difficulty in extending the above results to bound particles. For 
example, the Langevin equation of the harmonically bound particle is 

(3.24) J = ~(3u - a, 2 * + A(t), 

which in our treatment becomes 

(3.25) du = —f3udt — ufxdt + dB. 

The usual methods of solving the differential equation (3.24) are still applicable 
to (3.25) and again the distribution of u turns out to be Gaussian. 10 The 
distribution of displacements is then obtained as above. 

4. The 5(/.)-ijnpact process 

When the 5(/)-process and the initial conditions on u(0) are given, the solu¬ 
tion u(t) is determined b} r (3.11). Conversely if the solution u(t) is known, 
B(t) is determined by the equation 

(4.1) B(t) — 5(0) = (3 f u(s) ds + u(t) — a(0) 

Jo 

which is derived immediately from (3.3). The O. U. velocity distribution for 
the ?*(0-process can therefore be given only by the 5(/)-process described in §3. 
We shall investigate the possibility that a different choice of the 5(0-process 
might have led to a different velocity process compatible with the known 
physical conditions like Mi and M 2 . If we suppose that «(0) can be chosen so 
that the velocity at each moment is independent of subsequent residual random 
impacts, then we have seen that the 5(0-process must be differential, and is 
then uniquely determined by conditions Mi or M 2 . Any velocity process other 
than the O. U. process satisfying the Langevin equation and M[ or M 2 would 
therefore imply dependence between velocity and later residual impacts. This 
is really another way of saj’ing that the frictional resistance cannot be con¬ 
sidered as proportional to the velocity. Before going further we put a condi¬ 
tion going back to Maxwell in its modern setting. We formulate a hypothesis 
M 3 as follows. 

M 3 . In two or more dimensions (using any orthogonal axes) the velocity 
components are mutual^ independent. 

10 Cf. Ornstein and Wijk (16) and Wijk (17). The B(t, A) used in these papers corre¬ 
sponds formally to our dB(t). The difference is that it is possible to give a precise descrip¬ 
tion of the Z?(0-distribution. 
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In conjunction with the following lemma, due to Ka<? ((8) p. 278). hypothesis 
Ms implies that all quantities linear in the displacement or velocity functions 
have Gaussian distributions. 

Lemma . 11 Let (xi , y i), • • • , (x n , y n ) be 2n chance variables with the property 
that the sets of chance variables 

I xj cos 6 -f y, sin 0, j = 1, • • • , n\ { —x } sin 0 + y s cos 0, j = 1, ••■,») 

are mutually independent for each value of 0. Then (.rj , • • • , x n ) have an n-variate 
Gaussian distribution or a singular Gaussian distribution. 

We can combine the Maxwell hypotheses to obtain another justification of 
the (). U. velocity process. 

Theorem 4. Let the B(t)-process be any process such that the distribution of 
B(t 2 ) — B{t\) or of any quantity depending on such differences is unaffected by 
translations of the t-axis , and that the integral (3.5) can be defined as the limit in 
probability of the usual sums , with (3.6) valid. Then if u(t) is defined by (3.11) r 
and if conditions M 2 and M 3 are satisfied, the B(t)-proces$ must be precisely that 
finally obtained in §3, leading to the (). I ', velocity process. 

Suppose that condition M 2 is satisfied, and let m( 0) be fixed as in that condi¬ 
tion. Just as in §3, (3.11) then implies that the integral 

B*(t) = e? r dB{r) 

Jo 

has a Gaussian distribution with mean 0 and variance (kT/m)(e 2$t — 1). If 
condition M 3 is also satisfied, B*(tf) — B*(ti), and more generally any finite set 
of such differences, has a one or more dimensional Gaussian distribution. Using 
the fact that the distribution of e - *’[5*(s -f t) — #*($)] is the same as that of 
B*(t), in evaluating the expectations in the following equation 

(4.2) E{B*(s + 0 2 ) = £{[£*(«) + [B*(s + t) - £*(«)]]*}, 

we find that B*(s) = B*(s) - B*{ 0) and B*(s + t) - B*(s) are uncorrelated, 
these two variables are therefore independent. Going further, similar calcula¬ 
tions show that any differences B*(t 2 ) - £*(6), B*(s 2 ) - B*(si) with 0 ^ s, < 
^2 — 6 < ^2 are independent. Using the fact (derived from condition M s ) that 
anj finite set of differences has a multivariate Gaussian distribution, the B*(t)- 
process is thus a differential process. This means, by a method we have used 
above, that the Z?(0-process is a differential process, leading to the O. U. velocity 
distribution, because condition M 2 is satisfied. 

It is easily seen from counterexamples that Theorem 4 is no longer correct if 
condition \h is supposed instead of condition M 2 . 

5. Velocity processes not subject to Maxwell’s laws 

In all the above work the role of the Maxwell velooity distribution has been 
fundamental. In certain studies, however, other distributions play a somewhat 


11 The result is stated slightly incorrectly by Kag. 
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analogous role. ' It is interesting to note that the Langevin equation can be 
solved to give a distribution whose transition probabilities are asymptotically 
any of the symmetric stable distributions classified by L 6 vy ((14) §30, §56, §57). 
Such a distribution has characteristic function 

where a 2 0 is a positive parameter and 0 < y ^ 2 . The Gaussian distribution is 
obtained when y = 2. The parameter a\ plays the role of the variance, although 
the second moment is never finite when y < 2. The velocity process we shall 
derive will be called the O. U. ( y ) process. It is the O. U. process when y = 2. 
r l he (). U. ( 7 ) process can be described as follows. 

1. The process is temporally homogeneous, that is translations of the ^axis 
do not affect the probability distributions. 

2 . The process is a Markoff process. 

3. k or each fixed t, u(t) has a symmetric stable distribution with parameter 
value cq , exponent 7 . The conditional distribution of u(s -f- t) for u{s) = u 0 
* s 2 the stable distribution symmetric about Uoe^ 1 , with parameter value 
<r 0 (l — e~ yl)lt[ ) and exponent 7 . 

W e can obtain this process as a solution of the Langevin equation by choosing 
the ^(0-process properly. In fact, let the £(0-process be the temporally 
homogeneous differential process in which B(s + t) — £(s) has a symmetric 
stable distribution with exponent 7 and parameter value at. Let u(t) be the 
corresponding solution of the Langevin equation, given by (3.11). If y is the 
sum of two independent chance variables with stable symmetric distributions, 
having parameter values a\ , a\ , and with the same exponent 7 then y also has a 
symmetric stable distribution, with the same exponent, 7 , and with parameter 
value a\ + al . From this fact it is simple to check that the integral (3.5) in 
the present case has a symmetric stable distribution with exponent 7 and 
parameter value. 

I MV dL 



If w(0) is given a symmetric stable distribution independent of the B(0-process 
for t ^ 0, with parameter value a 2 /y(3, the distribution of u(t) can be calculated, 
using characteristic functions, and is found to be symmetric and stable, with 
exponent 7 and parameter value a 2 /yfi. The u{t) thus defined determines an 
O. U. ( 7 ) process, with the above three properties, setting a\ = a 2 /yd. 

We shall not spend any time on the details of the analysis of the O. U. ( 7 ) 
process, since the w ork runs parallel to that for the case 7 = 2 , already discussed. 
There are, however, a few essential differences. If v(t) is determined by the 
equation 

( 1 . 2 . 1 ) v (t) = t' ,y u(— 

\70 


log t) , 


t > 0 , 


12 Cf. Holtzmark ( 7 ). 
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the v(t) process can be analyzed using (3.11). The v(/)-process has the same 
distribution as the B(t )~process just described. The continuity properties of the 
velocity process can now be derived from those of the r(0-process, which are 
known. When y < 2, the velocity function u(t) is no longer a continuous func¬ 
tion of t with probability 1, but is certain to have discontinuities. These dis¬ 
continuities are however non-oscillatory (jumps). 13 We omit the details of the 
analogue of Theorem 1.3. Theorem 2.1 is still true if y ^ 1. The considera¬ 
tions of §3 have their obvious counterparts here. Lemma 3 played an essential 
role, but its statement and proof are correct if the variable y of the lemma is 
supposed to have a symmetric stable distribution and if the conclusion is that 
the Xj have a symmetric stable distribution with the same exponent as y. 
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fundamental theorems and their application. Beginning with discus¬ 
sions of sets, systems, groups, permutations, isomorphism, and similar 
topics, the author progresses in easy stages through the important 
types of groups. Except for a single chapter when an understanding 
of theory of matrices is helpful, no knowledge of higher mathematics 
is necessary for the reader to follow the author's presentation. Con- 
nections are established by Professor Carmichael between the theory 

of finite groups and other domains of classical and modern mathe¬ 
matics. 

Partial contents. Introduction. Five, fundamental theorems. Additional 
properties of groups in general. Abelian groups. Prime power groups. 
Permutation groups. Defining relations for abstract groups. Groups 
of linear transformations. Galois fields. Groups of isomorphisms of 
Abelian groups of order p'" and type (1,1, 1 ). Finite geometries. 

Collineation groups in the finite geometries. Algebras of doubly 
transitive groups of degree p" and order p" (p" - 1). Tactical con¬ 
figurations. 

783 exercises and problems. Index, xrv - 4 - 447pp. 5 3 /s x 8. 
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THE THEORY OF SOUND 

by Lord Rayleigh 


This major work of the Nobel Laureate and great 19th century 
physicist is a standard compendium of classical physics which has 
served generations of acousticians, physicists, mathematical physicists 
as the standard coverage of all aspects of sound, both experimental 
and theoretical. 

It both sums up previous research and offers original contributions 
by Lord Rayleigh. It is not only a reference book; it is also a work 
of great practical utility for all persons concerned with scientific 
aspects of sound. 

"An outstanding treatise," Review of Scientific Instruments. 
"Astonishing how this treatise . . . still retains a place of 
preeminence in modern acoustical literature," Electronics 
Industry. 

Partial contents. Volume I. Harmonic vibrations. Systems with 1 de¬ 
gree of freedom. Vibrating systems in general. Transverse vibrations 
of strings. Longitudinal, torsional vibration of bars. Vibration of 
membranes, plates. Curved shells, plates. Electrical vibrations. Vol¬ 
ume II. Aerial vibrations. Vibrations in tubes. Reflection, refraction 
of plane waves. General equations. Theory of resonators. Laplace's 
functions and acoustics. Spherical sheets of air. Vibration of solid 
bodies. Facts and theories of audition. 

Historical introduction by R. B. Lindsay, Brown University. Bibli¬ 
ography. 3 appendixes. 97 figures. Total of 1042pp. 

2 volume set, paperbound, the set $3.90 
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INVESTIGATIONS ON THE THEOkY^OF 
THE BROWNIAN MOVEMENT 

by Albert Einstein 

This is the complete text of 5 papers by Dr. Einstein on the Brownian 
Movement. (!) Movements of Small Particles Suspended in a Sta¬ 
tionary Liquid Demanded by the Molecular-Kinetic Theory of Heat. 
(2) On the Theory of the Brownian Movement. (3) A New Determina¬ 
tion of Molecular Dimensions. (4) Theoretical Observations on the 

Brownian Movement. (5) Elementary Theory of the Brownian Move- 
ment. 

These 5 papers have been translated by A. D. Cowper, and edited 
and annotated by R. Furth. 33 pages of notes discuss the history of 
investigation into the Brownian Movement, provide simple elucida¬ 
tions of the text, and analyze the significance and implications of 
these papers. The fifth paper is of great value as a simple explana¬ 
tion specially written for chemists and physical chemists. 

Author, subject indexes. 62 footnotes, mostly bibliographic. Edited, 
with notes by R. Furth. 124pp. 5% x 8. Paperbound $1.25 
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